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ABSTRACT 
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Lee INTRODUCTION 


In a recent SHARE study the annual growth rate of 
software demands over the years 1957 - 1985 was estimated to 
бе ав һіаһ ав 21-25% [15]. The same study indicates that 
software production may develop at a growth rate of only 
E »-1/z. 

Besides this quantitative aao, Boehm (7] ooints out the 
following aualitative deficiencies: Since software iS in- 
Epeasingly used for important functions such as defense sys- 
tems, traffic contro Systems, and medical purposes, 
software is needed which can be trusted. Although 80% of 
Ше money used for the production of the Apollo Manned 
Spaceflignt Program was devoted to testing {12), software 
EM rs occurred in Apollo 8, 11, and 13. One critical error 
even occurred during the lunar landing onase. 

Software engineering (for definition see Chapter II) may 
De accepted as the method which yields the answer to the 
problem of producing reliable software at reasonable cost 
(7). Little is known about Software errors besides their 
existence and their negative influence on cost and perfor- 
тапсе. Increasing cifficulties to produce sufficient 
amounts of hıah auality software make it mandatory to invent 
software development methods which are gesianed to avoid the 


most common software errors, achieve easier testing and 





debugging and improve methods of error detection. 

This cannot be gone without detailed studies about the 
occurrence of software errors. Only this knowledge will 
helo to identify the nature of errors ana finally lead to 
improvements of software ы E Other motivating fac- 
tors for this study were: 

1. Lack of currently available data to support analysis 

and research in the area of error ocurrence and 
detection. 


d. The need to examine existing software error models. 


The objective of the experiment was to aather accurate 
EE Complete information about errors, their occurrence апа 
detection throughout the entire process of software develoo- 
ment. Limitations of the experiment were the relatively 
small number of projects and tne lack of exoerienced oro- 
grammers. The use of the experimenter as the subject ого” 
grammer and evaluator introduced biases also. The scope of 
the experiment did not include the orogram maintenance 
phase. It was felt to be of great importance to record al] 
errors, even trivial errors which could hurt the imaqge of 
the programmer. A detailed descriptions, of the experiment 
S00 the error data is Given in chapters 4 thru 5 and in tne 


appendices. 





lI CONCEP Toe AND KEYWORDS 


Communication among computer scientists is hindered Бу 
the lack of common terminoloay. In order to avoid misunder- 
standing, the most important keywords will be defined in 
this chapter. Wherever possible definitions are adopted 


lpomwother publications. 


A. SOFTWARE ENGINEERING TERMS 


1. Software Engireering 

"Ihe practical acolication of scientific knowledge 
іп the design and construction of computer programs and 
the associateg documentation required to develop, 


operate and maintain them", [7] 


c. Top-Down Desian 

ÀA  oroaram design method whicn starts at a very gen- 
eral level oy identifyina major functions and proceeds 
stecwise to lower levels to the identification of lesser 
functions that derive from the major ones. "Too-down 
design" and "hierarchical orogram design" are equivalent 


terms. (12) 





D uctured Programming 

Although this term is used in numerous publications 
its understanding varies because of its conceptual na- 
ture. As proposea by Dijkstra as early as 1965 [301], it 
first was а concept to eliminate GO TO statements. 
Later on it was combined with the idea of top-down 
desian. [31] 

Rother han Providing a formal definition, Yourdan 
(121 and Auerbach [27] describe structured programming 
by its objectives: "increase of readability" and "ае- 
crease of testina problems." The following definition 
of structured orocramming as it apolies to this paper 15 


derived from Kirchgaessner's description. [28] 


Structured programming is a method of developing 
programs for whicn the underlying concept is a top-down 
design which eventually leads to a modular structure of 
the program. All algorithms are designed usina the five 
major constructs allowed in structured procramming! 

- Sequential statement 

- IF THEN ELSE statement 
SMILE loop (conditional Toop) 
БУХ loop (iterative loop) 


= CASE statement 


In addition to this)  aetinition it snould oe 


- || - 





emphasized that structured programming is a design dis- 
eipline rather than a way of writing code. Therefore 
MS Nou la” пос ве Зеттпе as “coding without GO TO 


Statements.” 


Methods have been developed to implement 
structured designs іп FORTRAN, (12) However, it is 
easier, ano more readable to use а block structured 


lanauage, such as ALGOL, to imolement a structured 


design. 


4. Directed Graph 
"A directed graph is a geometric graph, consisting 
ОГ поез and arcs with a direction of traversal associ= 


ated witn each arc." [16] 


S. Module 

"A module is a physical combination of program 
instructions that is independent of others with respect 
to compilina, assembling and loading and which performs 
a specific function." [16] "Each module has a small 


Bumnber Of interactions with other modules." [4] 


Ore Ргоагат 


A program is a set of integrated modules. (16) 


ГАЯ Software Develooment Process 


[he Software develooment orocess includes the 


- le > 





following staaes: 


= Problem Analysis 

= Design and Design Review 
- Coding 

= Debugging 

- Testina 

= Integration 

- Imolementation 


- Maintenance 


Despite minor differences with other publications 
such as Auerbach ШЕ the above view of the software 
development process will be adopted as the cefinition of 
the software development process for this thesis. 
Althouah the development stacaes are listea sequentially 
it should be noted that software production in general 
is viewed as a dynamic process inc ud ina feecbacks to 
earlier stages of a project. Thus none of these phases 
may be considered to be completed when the subseauent 
phase has startec. In some projects, testing itself 15 
preceded by activities such as ле гота of test 
specifications апа test procedures. Figure 1 indicates 
oossiocle feedback situations within a complex program 


development orocess. 
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| IMPLEMENTATION 


FIGURE 21 


ШОШ ЕЕЕ БЕЕК LE CILLES DURING A SOFTWARE DEVELOPMENT PROJECT 


ms Common Data 
Common Data 16 data which 15 used by several 


modules. 





В. 


TESTING, DEBUGGING AND ERRORS 


ШІ bDebudg)ng 
(a) Debugging is the action to check subroutines and 
modules as to whether or not they perform according 
to Programmer expectations., It is also the action 


which one takes to locate and correct known errors. 


(o) Testina is the action taken after modules have 
been integrated to check whether or not the program 
meets specifications. As statea by Dijkstra (291, 
testing can only establish the presence of errors, 


not their absence. 


Eee Software Error 

A software error is a mistake made during software 
Pe elements which leads to an Imeoirtect, асов or 
result with resoect to the proaram soecifications within 
Еле programi. [15] Errors made in the specification 
phase of the program, hardware errors and compiler er- 
rors (1.e. errors within the compiler program) were not 
Studied durina this experiment. Categorization and 


definitions of software errors WICCA respect to their 


occurrence are given in chaoter 3. 





SOFTWARE RELIABILITY AND CORRECTNESS 


1. Software Reliability 

"Software reliability is the probability that a come 
puter program will perform its (user) intended function 
for a specified time interval under stated operating 


Sonrdrt ions. 7) 


2. SoftWare Correctness 

“The feature of software that renders it operation- 
В иЕе IOC 155 intended functions is its correct= 
ness. Correct software does the thinas intended by 


mesidn." [9] 





I DEFINITION OF ERROR CATEGORIES AND TYPES 


When analyzing the causes of errors in software produce 
tion there is an obvious need to censes describe an error 
in accordance with its category and type. One of the objec- 
tives of this study was to identify errors with respect to 
their occurrences and causes. 


He Was was found that many errors in software production 


belong to one of the following major categories? 


oben especificat)|on Errors 
"NEN stem Design Errors 

Soe mocnan Oesian Errors 

ЖООШ О сатпоо Errors 

E or ica] Errors 

o e o y3GinG Errors 

(wees ine Errors 


8. Implementation Errors 


EEMUDEFINITONS OF ERROR CATEGORIES 


ШЕЕ lem Specification Error 

Алу mistake or deficiency which occurs in the 
analysis of the proaram application or ın specifying tne 
or iwasescecuncements witn respect to the intended proe 


агат spplicatjon such а$ 1 псото | еке, erroneous ог 





ambiguous statements. 


2. System Design Error 
An error mace іп the transformation of the user- 
origınated program specifications into systems design 


specifications. 


DEN Program Design Error 
A orogram desian error is one made in the transfor- 
mation of the system design into specific algorithms ana 


data Structures. 


Mee cocing Error 
A coding error is one which is made during the 


шрапатогртастоп О! а ргоогат design into source language. 


БО Clerical Error 

Ceall error is human failure which is made dur- 
ing the transformation of any onysical representation 
(such as a coding sheet) of tne oroaram or parts of the 
program to another physical representation (such as 


BUDch cards). 


5. Debuaging Error 
Inaoorooriate use of denugging tools, insufficient 


o inaooropriate selection of test cases, test data or 


= {A - 





mscameeroretation of denuaaing results. 


Ces tina Error 

тоэрргоргтате or insufficient test cases or test 
кее an Ssimeenstandıingrotzfunetjonal requirements of the 
program, deviation from test olan or misinterpretation 


of test results. 


Bu Implementation Error 

Unexpected environmental oroblem which occurs during 
the implementation of a orogram which could not nave 
been anticioated in а orevious stage of the Software 
development. This includes cases such as changes of 
haraware by the manufacturer and performance problems 


with operating systems. 


ЕСО Гаа о the cefinition of software errors, an error 
momen Goes not lead to an incorrect action or result within 
Be program cannot be identifiea as a software error. For 
example insufficient test cases during  aebuggina of а 
subroutine may not lead to a software error. However, the 
potential exists for undetected software errors when test 
cases are insufficient. ñecordinƏ со the definition of 
BeBuacina errors, errors of this category do not necessarily 
affect the croaram. Therefore debugaing errors will not be 


detected very often: however, because of being a potential 
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БЕРІП SOUfCE: errors of this category were considered to бе 
important. During the experiment described in chapter 4 all 
debugging errors were recorded. Similarly design errors, 
which were detected during a design reviewr’or faulty come 
ments were recorded. This was of great importance, since it 


yields significant information about error sources. 


pee DEFINITION OF ERROR TYPES 

The list of error type definitions given below identi- 
fies the most common types of errors within the major са- 
tecories of software errors. If approcriate, examples are 
einen for clarity. 

These definitions are imoortant because it has been 
Eccovered that without a definition of error types, errors 
ot the same type could be recorded ın different ways, not 
only by different orocrammers, but also by the same person 


at different tımes, 


№ Oesiaqnm Errors 
ме О Ыга types of errors apply to both са” 
teaories "System Design Errors" and "Program Design 


Errors”: 


D 1: Communication Error 


An error occurs due to 1moroper Communication 
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between members of a programming team or due to 
inappropriate systems design specifications. Тур! - 
Е com сев Іпгегересастот of common 
data and misunderstandina of module functions. 

D2 : Design Negligence 

ист ал оти У бес Soeci{tcatlons are 
neglected or necessary Cooperation with the 
Originator sts ef the soecification have been omit- 
ted; SUC əs Neglecting desired -outout formats or 
lack of documentation. 

05 > Forgotten Cases or Steos 

While solving the problem one or more cases have 
not been considered, such as neglecting leap years 
for calculation of dates or necessary step(s) to 
solve the problem have been omitted, such as deter- 
mining the status of peripheral devices before open- 
nc Sor forgotten conversion from decimal to 
Dinary OC vice versa. 

D4 : Timing Problems 

Misconceotion in scheduling Program events, such as 
asejanımea. тпасргоргітіасе priorities or changing data 
before completion of I/O. 

SE г оге im ТАО Concepts Е 

Errors made in the design of input or output, such 


as misunderstanding of hardware requirements of 1/0 


devices or channels. Typical cases are 
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misunderstanding of the capabilities of terminals or 
graphics devices, neglecting the size of lines on a 
lineprinter or the interrupt capabilities of peri- 
pheral devices. 

ЕЕ gh leh ror 

The data design does not fit tne needs of the pros 
агат. Typical examples are wrona sizes of arrays, 
buffers ог freelists. Also cases of inappropriate 
даса definitions, such that the chosen data types do 
not accomplish the desired precision. This error 
type also includes gesign of inappropriate I/O for- 
mats and improper design of common data. 

DM Inircialzation Error 

Wrong or incomplete initialization such as forgotten 
initialization of global pointers, arrays or flag 
ЕЕЕ OE Forgotten initialization of interrupt 
handlers. 

Vie. Inadequate Checking 

Checking of variables or input data is incomplete or 
WEemamocGcOcading to program specifications. 

09: Extreme Conditions Neglected 

Data ог Machine aependent extreme conditions are 
nealected, such as numeric values which cause un- 
derflow, overflow, excess of array limits or maximum 
values of real numbers or ıntegers, and occurrence 


of zero or negative values due to round off. 
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lO Sequencing Error 

Program events ог decisions scheduled in wrong зе- 

quence such as transformation from problem statement 

into a sequence of cperations. 

De Ines nssError 

Faulty index calculation such as designing an er- 

roneous alaorithm for accessina array elements ог 

items of a table. 

ЖЕ ОСЕ “СопЕгГО)І Errors 

Error yin controlling either an iterative or condi- 

tional repetitive algorithm, such as basing exit or 

Без Кеси ояе оп сопат сіолпо касп can never occur. 

013: Misuse of Boolean Expression 

An error is made in usina Boolean operators, such as 

constructing a false inverse of an expression. A 

trivial examole of this error tyre is solving 
БОО УЗИ Е оу’) х > 


instead of: 


i 
ғ 
x 

* 
< 
= 

a 
N 


Gy)! * 2 


' are the Boolean operators "OR", "AND", 


where +, kx, 
and "NOT" rescectively. 

D13: Mathematical Error 

The mathematical solution of a problem within the 
programming project does not or not always represent 


mem orrec t result according to the program Specifi- 


Cations. This incluges cases іп which 3 


Еос 





mathematical equation is simply wrong, ‚like a wrong 
formula for calculating a mean or variance of given 
set of numbers and cases in wnich the matnematical 
SOU toni does "not apply for all possible inputs, 
such as solving a sauare root for negative  expres- 
sıons. 

ИӘ: Representation Error 

An error is made in the orocess of the physical 
representation of thoughts, such as ‘writing design 
documentation different from what the desianer hag 
intended. 

puce cenwderstandyng of Proolem Soecifications 
Error resulting from misunderstanding the problem 
specifications. For example a decision table, 
developed during design, includes some undesired 
combinations of actions. 

Ol Orther Design Errors 

Any other design error which is not one of the types 


listea above. 


IR СА по Errors 


Ci : Misunderstanding of Design 
An error made in interoreting the desian specifica 


tions, such as misunderstanaing an algorithm, data 


= 





Пес Ыл оп ог Critical terms, such as mathematical 
expressions which leads to an error in implementa- 
tion of the underlying desian. 

Ce : Nealijigence 

Parts of the design are neglected or necessary 
cooperation with the designer(s) is omitted. This 
will include cases where programmers are uncertain 
about The eS. ог ports of it and fail to take 
aporooriate action, such as requesting an ехр1апә- 
mucrone the desiognerts) or obtaining the missing 
information from other sources such as project 
specifications, hardware or software manuals. 

о: Е ormat Error 

Use of improver 1/0 formats in coding, such as using 
formatted !/0 uhen nonformatted 1/0 is specified ог 
sme mapprobDriate record lencoths. 

C4 + Misolaced Nata Declaration 

Error made in declaring data either in the wrong 
toc илтте Coding іп ә block structured 
language) or in an inappropriate position within the 
source code. 

CS : Multiple Data Declaration 

Multiple declarations of same data. 

Co : Missing Data Declaration 

Necessary data declaration left out. 


ey > Inadequate Data 





ото те Choosing size or type of data; such as 
declaring single precision instead of double preci- 
sion. 

US Nazas tion Error 

moO forgetten initialization. 

C9 : Error in Parameter Passing 

Passing of parameters is incomplete, wrong or types 
do not match. 

CEOS Inadeauate or Foraotten Checking 

уе ОО O OU SW either incomplete or wrong 
according to program design specifications, such as 
mot checking for invalid input within a subroutine 
which receives characters from a user terminal. A 
typical case of this error tyre occurs when numeri- 
Сю = expected and is converted to binary 
About спескіпа the validity of the input charac- 
ter. Another case is an inadequate check of the 
ас па input number. 

C11: Level Problems 

mile COMINGS та а block structured language an error 
results from confusing block levels, such as 
misunderstanding the score of variables, e.g. an 
ALGOL programmer tries to use variables or data of 
а lower level within the main level (level 1) of a 
orogram. 


nx cssmossbPecilarations of Block Limits 
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Nte cocaina in а block structured language mandato” 
ry declarations of block level limits such as BEGIN, 
END are left out. 

C13: Case selection error 

An error is made in connection with a CASE statement 
or comouteq GO TO statement or an equivalent cone 
struct. For examole in an implementation of a GO TO 
SWITCH in CM¥S=2@ an error occurs due to wrong se- 
quence of labels. CMS-2 is a programming language 
used for tactical programming within military MEE 
cations (561. 

C14: GO TO Problems 

An error is made in connection with the use of a 60 
TO statement. 

els; Comment Error 

Stating a faulty or misleading comment. 

Ero; Forgotten Delimiter 

Delimiter left out. 

Elite tmconsistency in Naming 

An error is made when naming an identifier in dif- 
ferent ways. For example a Subroutine declared as 
GETCHAR is called by using GETCH. 

C18: wrona Use of Nested IF Statements 

Ап error is made during the construction of a nested 
IF statement. Errors of this type OCCUR іп 


transforming а flowchart or decision table logic 


LEO 





into nested IF statements or using an incorrect fore 
mat whitch will cause a compile error or associating 
any of the ELSE cases with a wrong IF clause. 
C19: Indexing Error 
Indexing is not aooropriate or left out. 
C20: Inconsistent Use of Variables or Data 
An error occurs because variables or data are used 
ТӨП сөптізпсібііпа purposes. For example usage of 3 
temoorary storage location in different parts of the 
program coulo oe implemented in such a manner that 
information. iS overwritten by some subroutine but 
still be needed by another Subroutine. Another 
examole is the usage of common variables for cif- 
ferent ourooses like pointer and index. 
СӘ Sequencing Error 
An improoer sequence of statements which leads to an 
error. For examole an exchange of array elements 1$ 
programmed 

ТЕР” е Аг) 

A(j) € TEMP 

А(1) e A(j) 
which does not accomolish the desired exchange of 
the two elements. 
C22: Flag Usage Problems 
An error is made in using flaas in order to control 


program loge. 





pos Syntax Error 

Violation o f syntax rules of tne programming 
language. ИЕС 5 inel udes errors Тп commection with 
transformation of boolean exoressions and arithmetic 
expressions. 

Aoc Control Error 

Error in implementing the control structures of an 
Келме or Conditional repetitive alaorithm. 

pos NMENDCUPCPect Exit from Subroutines 

AS OR occurs in thé implementation of an exit 
fron a súbroutine. 

C26: Language Usaae Problems 

An error is made due to idiosyncrasies of the рго* 
aramming lancuaae which are not thoroughly unaer- 
вое бу the programmer. 

в огаоссеп эсасететсев 

AS demey leaving out a necessary state~ 
ment which tne programmer knew was necessary. 

CoB: Representation Error 

A codina error which is introduced guring the pro- 
cess of the physical reoresentation of thouahts, 
such aS writina a statement different from what one 
intended. 

Se onto) sequence Error 

An error is made which causes the program to ен 


эго Бгапсп атсег а decision. 


I 





C30: Incorrect Subroutine Usage 

Using the wrong subroutine or using a subroutine 
inaporopriately, e.g. a Programmer's expectation of 
what a subroutine will accomplish is different from 
what the subroutine actually does. 

CSI: Other Loding Errors 

ny other coding error which is is not one of the 


types listed above. 


Ben Clerical Errors 


лапа т “Error 
а его песо їс from lack of motoric skill or 
temporary manual misfunction, such as 
ШЕР ОР болт: стор (e.g. writing or typing 
"busu" instead of "busy") 
errors OF  OMI1SSiOM (e.g. writing or typing 
"BONN" instead of "BROWN") 
Ios sof. |tanspositiom Ce.g. writing or typing 
Bice instead of "the") 
Ag : Mental Error 
An error resulting from a mental misfunction, such 
as 
- Perceptual Errors (e.g. reading "0" instead of 


ul instead со” ІІ ог "DOG" jnstead of "DOD") 


aM 





ЭИ соста о гог (e.o. IM 3 given context а 
certain word or exoression is exoected and the 
actual word or expression is overlooked, such as 
assuming "FOR I:=N STEP 1 UNTIL M DO" where "FOR 
NA UNE м DO" is the the actual im? 
plementation of an iterative looo in ALGOL И.) 

A O ceo Errors 

Given a proper assianment for a clerical task which 
imolies some well defined secuence of actions which 
could be expected from the assignment, some of the 
steps are either forgotten or mot carried out prope! 
erly; such as some lines of code on a coding sheet 
are omitted by the keyounch operator or cara correc- 
tion procedures are not followed aopropriately or 
inserted cards are misolaced. 

AY : Other Clerical Errors 

Any other clerical error which is not one of the 


tyoes listed above. 


Datos. Errors 


DI Inaporocriate Use of Debuaaing Tools 
ronga selection of debuggina tools, such as traces; 
snapshots or aumes or using them inacorooriately. 


For example usina a snapshot before instead of after 





ascertain instroction or taking a dumo of wrong 

memory locations. 

x леш степ “ог Tnaperopriate Selection of 
Test Cases or Test Data 

The test cases or test data provide insufficient 

test coverage of the proaram or fail to provide 

testid O critical Darts of the ргоогат. 

Rš +` Misinteroretation of Debugaing Results 

An inappropriate action is taken due to misin? 

teroretation of debugging results, such as a wrong 

result is overlooked ог PLUS UO of а 

correct result eee to additional errors. 

е гегргетагіоа of the Error Source 

An inapprropriate action in correcting a discovered 

software error that results from wrong assumotions 

about the error source, such as correcting the ѕутр-~ 

toms ӨТ ап error rather than its cause or the pro- 

grammer fails to foresee the imoact of a change on 

other parts of the proaram and inserts additional 

errors into the program. 

85 : Negligence 

Errors гесшіісіга from negligence in debugaing. For 

example the implementation of an error correction is 

assumed to be error free without further checking. 

mor Перес Debuasıng Errors 


Any other  debuggina error which is not one of the 





types listed above. 


Testina Errors 


Idee Test Case(s) or Test Data 

Selected test casels) or test data do not properly 
test the program. 

lc c c0nteponreration Of Test Results 

An inaopropriate action is taken due to misunder- 
standing of test results, such as a wrong result 1$ 
overlooked or nısunderstaänding of a correct result 
lusto an wEmplementationwof additional errors. 

I x tembretat)ion of Problem Specifications 
Error(s) resulting from misunderstanding the program 
soecifications, such as incorrect interpretation of 
ПЕ елес functions which leads to an insertion 
Men On OF to over looking an existing error. 

T4 : Negligence 

Errors resultina from negligence іп testina. For 
examole a tactical real time system is merely tested 
within specified limits ana tests fail to examine 
the behavior of the system for cases where limits 
are exceded. In this particular example negligence 


сав саше беғтошѕ results in eritical situations. 
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Peer Other Testing Errors 
Any other testing error which SAO cone of the 


tyoes listed above. 


In order to get meaningful results, the above defini- 
tions vere used throughout the project. This list 1$ not 
considered complete. However, it permitted identification 
of software error types for the purpose of this exoeriment. 
Some of the listed error tvoes could be further subdivided 
into subsets of eacn type if this were desired. 

®© contribute. to analysis of error sources, 16 was 
Medea to list the same error type which occurs іп dif- 
ferent software development phases under different ca- 
tegories. For example one type of error which has the same 
mame €lcom control error) may occur in both design and cod- 
ШЕ оһазес. However, the cause of the error could bé dif- 
ferent. 

Error severity is related to the effect of the error on 
System operation. There is no direct relationship between 
error tyoe and severity. For example mistyping of a single 
character of a variable name in FORTRAN can cause strange 
results, whereas the same error made in a comment may not 
affect the program at all, The consideration of error 


Severity was oeyond the scope of this project. 





IVE EXTERINEBTI DESCRIPTION 


А, GENERAL REMARKS 


Error data were gathered in four programming projects 
ranging from small to large. During 280 man hours of total 
project time more than 2000 source statements were produced. 
total of 115 errors were recorded. 

The scope of the programming projects was limited to the 
followina software development phases: 

- Design and Design Review 
- Coding 
- Debugging 


- Testina 


DESIGN OF TRE EXPERIMENT 


The exoeriment was gesigned to guarantee the most accu. 
rate recording of relevant error information. Therefore, 
for each of these ohases, an appropriate form was designed 
to qQive a firm aquiceline to the experiment programmer for 
recordina the entire development of a program Rc ludina 
necessary details about errors. The error data which were 
recoraea on these forms for project |І, 2, 5 апа 4 аге given 


іп Acoendices A, B, C and D respectively. For each croject 


5.55 = 





the recorded data was analyzed with respect to the following 
factors: 
= Number of source statements Sroduceo 
- Man hours seent on the project 
- Man hours scent in each of the software 
development chases 
- CPU time used for compiles 
- CPU time used for test and debug runs 
- Number of test and debugaing steps needed 
= Project time used to correct errors 
- Project time between error detections 
EUceUEremcesoft errors with resoect to software 
development onases 
= Detection of errors with respect to software 
development phases 
КОТЕ Story Of error detection and correction 
- Complexity measures of subroutines 
А summary of this analysis is documented at the end of 
each appendix. 
Nc 90110 бе too difficult to obtain error data in 
a commercial environment, it was neccessary to obtain the 
data by using a carefully controlled experiment in an 
academic environment. The considerable overhead necessary 
record all relevant data was not included in project 
time. It probably woula not be feasible to conduct Elus 


kind of experiment in a commercial environment because: 


E 





- The overhead woula be very costly. TeS unlikely that 
management would support an experiment of this type. 

- Competition among programmers would probably not allow 
accurate results to be obtained. 

- Programmers may feel] that the error data would be 


used for performance evaluation. 


In addition to сасһегіпа Quantitative error data an 
attempt was made to obtain other information about the na- 
ture of errors such as "why was the error made?" or "how was 
ШЕ! еггог discovered?". This information coulda help to deve 
ise methods for avoiaina certain tyoes of errors. For each 
Subroutine a directed araph representation was analyzed with 
respect to the following comolexitv measures: 

- Number of Nodes 

- Number of Arcs 

- Number of Statements 
= Number of Paths 
“Reachability of Nodes 
“Cyclomatic Núümber (501 

The results of this analysis are shown together with the 
directed graph representation of the programs in the appen- 
dices. For some structures these measures are not shown 
because the number of oaths and the reachability index was 


ООО large to calculate. 





C. PROGRAMMING ENVIRONMENT 


tmemuncerlyina program specifications of all projects 
were well defined and not known by the experiment orogrammer 
before the experiment. The experiment programmer was fami- 
liar with the objectives of the experiment and willina to 
record accurate data to the best of his knowledge, even 1 f 
recorded facts seemed to be unfavorable for himself. 

Throughout the experiment software development was done 
in a structured and ohase oriented approach using structured 
programmina and known software development techniaues, such 
as top-down design, modularization, decision tables, etc.. 

As a oroaramming environment the 05/%60 system was 
chosen as one of the most representative batch processing 
Systems available. Batch orocessing was always used except 
for the final test and debug runs for project # U, because 
this program was desianed to run in a time sharing environ- 
ment. Durina the exoeriment all environmental factors, such 
as overatina system and equioment beina used and the pro- 
aramming language remained unchanged. Factors related to 
the experiment programmer, such as NO knowledge, and 


experience did not vary considerably durino the experiment. 





YPU ANTITATIVE RESULTS 


A. DISTRIBUTION OF PROGRAMMING EFFORT 


Пп Table | LtuewEdistmybutucon' ofteproject time 15 shown 


with respect to the major software development phases. 


PROGRAMMING EFFORT (MAN HOURS) 


PROJECT Projecti ProjectiProjectiProjecti Total 
PHASE в | : зо # 5 z d 
--------- %-------%-------%-------%-------%-------- 
DESIGN i SAO SIO O O. s 67.0 
E A te lee.) (o 62) (os 99%) 
--------- %-------%-------%-------%-------%-------- 
CODING | О Моб Оу! ЕШТЕН СЄ! 61.5 
ООСО ОО ЕУ У (2432) (21.9%) 
--------- %-------%-------%-------%-------%-------- 
DEBUGGING! II o 0а Be 25! OES 
9.1%) (4) 2.14) 1 056.9%) 
--------- %-------%-------%-------)-------4ҙ-------- 
TESTING ' Saale l1 S203 Diese, 110 j 585 
BOTT О. 92), 657.62) 1010.9%)1 (17.4%) 
--------- %-------%-------%-------%-------%-------- 
SUM ОБОВ 2500 7 10120-17 280.8 
ABLE 


OS TIBUTTON OF PROJECT TINE DURING THE EXPERIMENT 


EN MIGIN OF ERRORS VS DETECTION OF ERRORS 


Тһе final Statistics of each project contains tables 


showing the numbers of errors made and the number of errors 
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found with respect to each o f the software development 


phases. A summary of these tables is presented in Table 2. 


| = OF ERRORS FOUND 


ЕО ЕСТ iProjectiProjectiProjectiProjectiTOTAL (Percentage) 
i I 
I If 


PHASE КА se cic 3 #4 | 

--------- %-------е-і-----е--ф-------)-------)------------------ 
DESIGN i 2 | | | DECLINE) 
--------- %------”-%----“--%-------%-------%-------------...... 
CODING і da | 517 5 ie 7 д оол да (27.7 %4) 
--------- a <= = + = <= = = +} ч з = = = = з {} =з == = = = +} == = = = ош = = = = = = ошо єє = = 
DEBUGGING! oO Sa T 57 “1 go uo (солгу 
--------- %-------%-------%-------%-------%------------------ 
TESTING t 1 ' ' ' 1 i 2 С 1,2 2) 
------- < %-------)-------)-------ф------- іҙ-----------------. 
SUM ' “ un 3 f Slime tes. C00 4 


' # OF. ERRORS MADE 


ЕСТ iProjectiProjectiProjectiProjectiTOTAL (Percentage) 


PHASE 
--------- %-------%-------%-------4-------%------------------ 
DESIGN I > Ті 20 {| ' O SS Oe 4) 
--------- %-------%-------%-------%-------%------------------ 
CODING i s SS Q4 Se ele COO.) 
--------- %-------%-------%-------%-------%------------------ 
DEBUGGING; 1 i е, ' 5 | O Sa) 
--------- %-------%-------%-------%-------%------------------ 
TESTING | ' ' ' ' JE PESO Уу) 
--------- %-------%-------%-------%-------%------------------ 
SUM | 44 i ПЕ” 4 | SOME QUON DUUM) 
TABLE 2 


(OPI DCTECTION VS ERROR ORIGIN 





С. ERROR CORRECTION TIME AND TIME BETWEEN ERRORS 


E ro? Correction Tine 
The mean time to correct an error calculated over 
all 173 errors was 12.2 man minutes. 
о. Time Between Error Detections 
The mean time oetween error detections calculated 


ever all projects was 61.6 man minutes. 


ШЕ СЕКОК ТҮРЕЗ 


All errors which occurred during the exoeriment could be 
identified by one of the previously defined error types. An 
overview of error tyoes with respect to their frequency of 
occurrence is oresented in Table 3. Error types which did 
EM c ur are mot listed. In addition to the information 
given in Table 3 a bar chart (Table 4) is shown which  iden- 


tifies the most common error tyoes, 
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TABUE 
WITH RESPECT TO ERROR TYPES 


DISCOVERY 


ERROR 





ERROR | 
ше 1 FREQUENCY OF OCCURRENCE 


------+------- == е е о еа ео оа ча са ао ча ча ча ча ев а еә р «е ча еә ә ә еә аә еә ә ә ә еә ә ә аә еә еә ҹә Әә аә Әә ә ә ә аә ә 
0 5 AAA RA A 

D9 | ok XX X X x x X x 

D11 (XXX 

D12 CARA AR 

Co (kk ks 

ЕГІ | k X X x АХ 

С12 Ok k X kx 

£17 kx X kx x Xx x x 

rei keke 

Ce 3 Vek keke kkk KK 

С24 | kK 

C27 ! Ok ok do kx X XX 

[28 ! Oc oc XX KR KAR KKK 

A1 QU OK AA ARA AA AAA AAA A A 
А2 AR 

Other | 


ErrorS i XXX kk kk k k kk k kk X Kok X X X X X X XX X kx 


TABLE 4 
MOST FREQUENT ERROR TYPES 


\ 


ERROR OCCURRENCE RELATED TO COMPLEXITY MEASURES 


One of the objectives of the experiment was to determine 
the relationshio, if any, between error occurrence and the 
structural properties of subroutines. UT “particular. п 
terest was the analysis of structural Properties with 
fesoect to the error simulation work done by Schneidewind, 
Howard and Kirchaaessner [531]. In addition the cyclomatic 
number as defined by McCabe 1532) for software  enaineering 
Purposes, was used іп the analysis. The results of this 


analysis are shown in Table 5. The follow definitions 


> MS 





and terms are used in Table 5: 


Np 


Tf 


ГС 


Тһе 


Number of Paths (minimum number of paths: no 


loop traversed more than once in succession) 


Me lomatic Number: number of independent circuits = 


number of arcs - number of nodes + ? 


Reachability: summation, over the nodes, of number 


of ways of reaching a node 


Average reachability: R/nurber of nodes 


Number of Source Statements 


Number of Errors Found in Actual Program 


Ebor Time Required to Find Errors 


(Smee Previous Error Detection) 


Шасог lime Required to Correct Error 


All of the above are with respect to a single progran. 


etm ciom of Y includes an implicit arc connecting the 


ИЕГІ and terminal noces (strongly connected graoh). 


= (i = 





TABLES 


ВОВЕ COLIN VEASUKES VS. ERROR PROPERTIES 


Part A = Procedures th Une or More Errors 
COMP EEXITY MEASURES ERRORRPROPERTITES 
MO ect / (Мап- (Man- 
Procedure No у R r 9 e mins) mins) 
1⁄1 E 2 7 1.4 14 l 55 10 
15 * 6 ж x 26 5 95 55 
1/6 * 5 * x 7 2 37 55 
1/8 * 3 k k 2l l 55 15 
1⁄9 2 2 8 22358 6 1 115 20 
РИН. 19 1 l 2 10 5 l 10 10 
EN. ei 1 1 2 10 | 1 110 10 
2/2.2 2 1 ü 1.0 8 l 15 10 
ВИТ 3 2 D 1.4 > 250 45 
2/9 l2 8 370 ЭТА с 3 140 185 
2/10 9 4 25 CERTES NS 1 10 5 
E11 * 6 * * 54 3 950 Ce 
2/12 5 2 13 а 2 500 50 
e715 ж 4 к k 19 1 5 1 
27106 * 5 к k 30 2 150 29 
СТА ine ü 29 2.941 26 1 5 [5 
2/21 * 16 x * 94 8 50 145 
3/3 2 2 6 5 lcs l 60 5 


* Very large value 





ALBUE S 
(continued) 


Part A = Procedures With One or More Errors 
5> T$ Sire 

Иго јести (Мап = (Мал - 
Procegure Mo V R r 5 е mins) mins) 
4/7 40 6 151 $4058. 83 1 120 5 
4/13 16 5 64 MS 28 1 20 | IS 
4/14 * 8 * * ST 5 253 65 
2715 4 3 1 2 D (22 2 40 35 
Eso. 7 3 34 4.957 16 1 0 5 
Bec * 7 ж ж 54 1 160 30 
4/23 18 5 60 9.615 294 1 125 1 0 
4/27 5 4 25 c. 091 224 360 120 
4/28 * 5 ж ж 59 90 50 
4/29 Do Шы 1958 SU THES, 1125 160 
4/30 6 4 24 2.4 IE 60 30 
n 21 ж 4 ж k 27 50 10 
4/35 14 4 6 ® 17 55 10 
* Very larae value 


dons 





TABLE 5 
(continueo) 


Part B =- Complexity Measures for Procedures 
With Zero Errors 


Project/ 
Procedure No 


IN 
IN 
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КАЛЕ = 
(continued) 


Part B = Complexity Measures for Procedures 
With Zero Errors 


Project: 

Procedure Np V R E 5 
4/1.18 1 1 e 1.0 3 
AS 1 1 2 570 5 
в ео 1 1 2 Ша) 5 
avec 1 1 г 0 6 
ME 1 1 2 1:0 9 
471,25 1 1 2 1550 6 
4/2.1 2 1 4 l0 8 
4/2 2 2 1 4 1-0 9 
2» 2 1 Д 1-0 9 
4/3 2 2 6 9 4 
4/4.1 2 С 8 exe 7 
4/04 .2 2 2 8 е 9 
4/5 8 4 28 A222 56 
4/6 ü 1 6 О eu 
478-1 2 2 8 6 K. 
ааа 2 2 8 1 „б > 
4/8.5 2 2 8 17:6 10 
4/8.4 2 2 8 Ша 9 
do E 2 2 8 №6 ШЕ 
4/9 16 5 95 735917 21 
u/ 10 12 5 65 4.643 49 
a p 5 58 54029 19 
4/12 ж 4 қ x 20 
4716.1 2 2 6 5 6 
4/ 16.2 2 2 6 155 12 
еа 2 2 6 1.5 9 
4/16.4 2 2 6 a5 10 
4/17 ШЕ 1 18 1520 21 
4718 8 4 42 | 
4/19 4 3 16 QD 11 
4/90 3 2 9 1A es i5 
AE 7 3 34 OST 14 
4/24 15 7 83 4.568 19 
4425.1 2 2 8 12535 5535 15 
uS 2 2 8 102555 10 
dcs 2 2 8 2355 7 
4/26 5 5 15 1565 19 
0752 7 3 36 52185 15 
4/34 2 2 5 205 15 


* Very larce value 





Weqnmig the results of Part A in Table 5, the following 


correlation coefficients were calculated: 


V vs. e 3 .7834 
SVS... Ee ~ -50090 
VV cr. De. OO 
М vs. Zen: 27225 


е м5. Т „5902 


S ув, Die Os -5091 


Vo ys. 9 : 51905 


Ше relationship between mean complexity values and 


error occurrence is shown in Table 6. 


Zero Errors One Or More Errors 
A1 Procedures 51 Procedures 
Hean Cyclomatic 
Number (V) 1.68 4.74 


Mean Number of Source 
Statements (5) 9.33 gio 


TABLE © 
Peloton "BelWwEEN MEAN COMPLEXITY 


VALUES ANO ERRORS FOUND 





VI. SUMMARY AND CONCLUSIONS 


| — 


A. GENERAL REMARKS 

Due to limited man power and time constraints the amount 
ШЕ Гесс data was too Small to allow major conclusions. 
Furthermore the scope of the experiment did not include some 
important programming problems such as real time and 
mathematical problems. However, taking all constraints into 
consideration some aualitative aspects were recoanized which 


could be important factors in subseauent studies. 


SIGNIFICANCE OF ERROR TYPES 

Евой ‘Ве cateaqorization and definition of error 
tyoes was not considered comolete, al!) errors detected in 
the exoeriment could be identified using these error defini- 
mons. The most frequent error type "A1" (Manual Error) 
seems to be relatea to the number of source statements 
whereas the freauencies of the remaining errors seem to се 
related to the complexity of the orogramming problems. 

The recording of errors with respect to their tyoes con- 
tributes to a learning process which enables the programmer 
to reduce the number of errors made on subsequent projects. 
It was felt that this concept could also be effectively used 
in a commercial software production environment. The error 


Necordima would have to бе private to the individual 
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programmer and used by the proarammer alone. Otherwise it 
would have a negative influence on working atmosphere and 
performance. If the evaluation process were assisted by 
appropriate software packages, the overhead in analyzing 
errors would be reduced to a great extent. The overhead of 
recordina the errors for the individual programmer tends to 


decrease after the recordina system has been learned. 


COMPLEXITY MEASURES 

Several measures of complexity calculated for each 
subroutine are presented in the appendencis together with 
subroutine directed graph reoresentation. “hen the number 
of errors found in procedures was correlated with cyclomat- 
іс number and number of source statements, the correlation 
coefficients were hiaher than for other complexity measures 


541. It also aooeared that these two measures were related 


to the total error detection and total error correction 
times. it was learnea that trying to keep the cyclomatic 
numoer small not only reduced the number of errors but also 


memeriOuted to the reduction of aebugaing and testing ешт 
КОБЕ. Г This experience supports the results of McCabe's 
analysis of structural properties of programs with respect 
Eu ftficulties in testing and debugging 1501. ІС should be 
noted that the influence of other factors such as usage of 


 исеигес programming techniques and working habits of the 


experiment programmer also contributed to these results. 





ШІ SOFTWARE ENGINEERING ASPECTS 

Throughout the experiment comments were made to indicate 
possible clues about error sources or ways to avoid certain 
types of errors. An evaluation of these comments showed 
that some of these errors would have been avoided by the 
usage of decision tables or aoplying a proper desk test. 
Many key punch errors of type "41" were not recognized dur- 
ing the process of pounchina cards, because the design of the 
key punch machines (IBM 29) does not provide an immediate 
control of characters being ounched. It is desirable to see 
the result of each key stroke instantaneously. The freauen- 
EN f error occurrence of type "Manual Error" in former pro- 
jects done by the Same programmer using console editing was 
considerably lower than the error frequency discovered in 
this experiment. 

Software engineering concepts such as too-cdown design, 
design review and Structured Walk Through were used 
Eupnoughout all! projects. These methods had a major. influ- 
ence on the software gevelopment process and were considered 
to be extremely useful. 

The usage of ALGOL w haca a major influence on the pro- 
gramming style. Variable names were chosen to make programs 
self-documenting to a great extent. Therefore most proaram 
parts were easy to read and to understand which implied a 


Mee@uction of the debuaging effort. 
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Another concept which was successfully employeo was the 
Mies of using identifiers which differ by two or more char- 
acters. The idea of implementing some kind of "Hamming Dis- 
tance" (55) between identifiers was derivea from bitter 
experience in former projects and heloed to avoid errors 
СВ occur when a single error of tyoe "Manual Error” or 
"Mental Error" produces a different identifier which matches 
with one of the previously defined identifiers. Thus this 


ШЕГІ ОТ еггог did not occur during the compiling process. 


ШІ CONCLUSIONS 

Errors in software projects appear to be related to "m 
gram structure and to the number of source statements. 
Although this experiment was not larae enough to state these 
relations in a formal manner, the results were encouraging. 
Cyclomatic number and number of source Statements could 
prove useful as guidelines for managing proaramming рго- 
Jects. 

The usage of too-down desian, structured programming 
techniques and other software development tools should be 
mandatory for orogrammina projects. The recording and 
evaluation of software errors would be a reasonable approach 
to avoid errors in programming projects and to reduce cost. 

Detailed debugaina on a modular basis ana development of 
large programs by stepwise intearation of thoroughly de- 


bugged modules seems to be a good strategy to achieve 
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reliable programs. 


Е. RECOMMENDATIONS 

Similar experiments would reveal more of the relations 
between software errors and comolexity of programs. More 
definite information about the utility of Complexity meas- 
ures could be obtainec by using these measures оп large- 
scale software projects in a commercial production environ- 


ment. 





APPENDIX A 

BEOSECINDESCRIPT TON 
Epoject 2? : ] 
Project title : PALINDROMES 
Programmer : HOFFMANN 
Programming Language : ALGOL 
Programming environment: IBM/360/67,0S/MVT,BATCH 
Design notes : see ANNEX A 
Program listing : see ANNEX B 
Coding notes : see ANNEX C 
Debugging notes : see ANNEX D 
Вог Listing : see ANNEX E 
Final statistics 2 see ANNEX F 
Graphical representation : see ANNEX G 


Test phase description: see ANNEX H 


Starting дате: 28 JAN 77 Fo pno date: 6 FEB 77 


EXTFERIVENT DESCRIPTION 


l. Project description: 
FINO PALINDROMS 
A palindrome is defined as a character string of length 


n, which has the followina characteristics: 


character{1i} - characterín - i - 11 for all i from 


ІЗ to 1сп/2 Cintecer division) and n >= 2 


SEC - 





Given an input string of length n, where 2 <= n <= 256, 
find all occurrences of palindromes, 
The input is given in form of punched cards. 
The length of the string ("I") preceeas the input of the 
Character string. 
All information beina read should be printed. 
Give as a result the number of palindromes ОЕ басп length 
and the position of the starting character of each palin- 
arome in card number and character position. 
mrad only maximal length palindromes. (i.e. "ABC CBA” should 
be recorded as the palindrome of maximal length, whereas the 
included palindromes "ВС СВ" апа "С С" should be exclud- 


ed.) 


€. Programmer's background: 


a) Experience in proaramming: 
Oct 1970 - Мау 1971 Proaramming courses 
May 1971 - April 1972 Module Programmer 
May 1972 = June 1974 work in Test and Simulation Depart- 
ment at the 
NAVAL COMMAND AND CONTROL SYSTEMS 
COMMAND (FEDERAL GERMAN NAVY) 


Testina of tactical real time systems 





March 1975 - Jan 1977 Student at the NAVAL POSTGRADUATE 


SCHOOL, Monterey, Computer Science 


b) Experience іп testing: 


Two years of work in testing and simulation. 


C) Experience in the area of the given problem: None. 


d) Experience in the progamming language being used: 


Experience over a period of 18 months in more than 10 


programming projects. (Total number of source statements 


produced durina that time was more 4000.) 


5. 


Psychological factors: 


a) Did the programmer like the project? Yes. 


b) How does the programmer like the programming 
language? 


Favorite programming language. 


C) Was the programmer satisfied by the way the problem 
was specified? 


Only minor criticism. 


d) How did the programmer like the programming епуігоп” 
ment? 


The facilities (study room, card punch room) were not 


conducive to efficient programming because of restricted 
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Ce; bad lighting and noise. 
e) Other factors: 
The recording of the exoeriment's data during the рго- 


ject affected speed and concentration considerably. 





4. Comments on Documentation 

For the documentation of each software development phase a 
special documentation form has been developed. These forms 
are designed to provide a firm auideline for the experiment 
programmer to record all data of interest for subsequent 
error analysis. 

- Beain and end of each step was recorded with respect to 
day and time. 

БЕС еггог was recorded when it is discovered. The error 
was then identified by a unique error number (1,2,...). 
Furthermore the time of discovery and the error tyoe (using 
error types listed in ANNEX F) were recorded. 

- If appropriate, cOmments about error discovery» reason why 
the error was made, etc. were documented in ANNEX Ee. 

- For each error the chase in which the error was made, the 
phase іп which the error was discovered and the time spent 
to correct the error was recorded in ANNEX El. 

For each step in any one of the software development 
phases the day/time of begin and end was recoraed. In addi- 
tion, the time (in man hours) for each step was recorded. 
This excludes the overhead used for documentation of the 


experiment data. 
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WORKSHEET FOR OESIGN PHASE AND DESIGN REVIEW PHASE OF PROJECT # 1 


' ' | ! MAN |! 
STEP! PROBLEM ANO PLANNEO SOLUTION ! ALTERNATE ¡DAY ¡HOURS!ERROR! COMMENT 
a! i SOLUTIONS ITIMEJ/STEPI # f 
! | ' ' ' ' i 
1 | Too-0own Design: ! 11/28! ; ' 
¦ Use the following building 1040! ; ! 
to blocks: ' ' ' ' н 
feInitialization ! ' н ' ' 
' Реза and write Inout Cards ! | ' ' ' 
I=Find all Palinqromes which i ' СТеК! ' 
¦ are not totallv included in | ! ! ` 
| а larger palindrome ¦ "0o not allow | ! ' ' 
| find also valindromes | overlaopina ' ' ' ' 
|! «hich are overlapoing? ¦ oalindromes. ' ' ' ' 
| ABBAXA will be recorded as ! Tris allows two! ' ' н 
! t«o palindromes: |; Solutions: ' ' ` І 
! ABBA and AKA ¡lo Always record; ' н н 
tewrite all palindromes beina ¡the first palin-; t : : 
| found ‘drome. ' ' i ' 
¿“The necessary inputs 52% E recordi : ' ' 
! 1. length of string ¡the larger bae | ' ' ' 
| 9. character string ot given ar on If оса"! ' н ' 
' length il indromes are of} ' ' 4 
| are expected from cards. ¡eaual lenath, ' i ' ' 
' (then. record the 11/28) ' ' 
' first one, 1155071 ' | 
' ' ' ' ' ' 
2 | Specify Initialization: ' 11/28! ' ! 
ı=Initialize all arrays and È 11330! : : 
! variables ! i ' ! ' 
i “Write explanatory text i ' ' ' ' 
‚ “Реза length of input string $ ! ) I 4 
ı and check(assert 2<= length | ' ' ' 
1 of string <= 256) ! ' ' ; ' 
¡“Set integer field size to S. |! ' ' ' ' 
¡“Use all 80 columns of the i ' CES S EM l 
| input cards (specify as com- | Cardlimit could) ' ' ' 
| Dile parameter CAROLIMIT) | be specified bv! ) ' ' 
' ı user via incut !1/28! ! ; 
' + parameter, 1409! ' ' 
Remarks.: 


Because of the small size of the project the system design phase 
14 omitted. ⁄ 


Total man hours spent in design: 5.0 
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WORKSHEET FOR CESIGN PHASE ANO DESIGN REVIEW PHASE OF PROJECT z 1 


| I MAN | 
STEP; PROBLEM AND PLANNED SOLUTION ; ALTERNATE DAY ¡HOUPS¡ERROR; COMMENT 
F ! SOLUTIONS ТІМЕ)/5ТЕР! я | 


1728: 


' 
3 | Soecify Reading and Writing 
14001 


of Input Cards: 
("Number of input cards is де” 
'cendent on CARDLIMIT and sope- 
'!cifieg length of character 
String. 
ШӘ 165 calculated: 
‘Number of inout cards= 
(length of string -1)/card- 
limit + 1 
“Maintain a card counter 
-"ead and write each card pre- 
ceeded by the aporepriate 


Card number. 1/2 


>> 
un 
<> 
O o 


“Use a text buffer (Text) 
(String Array Indexing fron 1 
through 256) 


peo po pr 
un un x 
oo pn 
ut C COD 


will oe 
redesigned 
curing 
design 
review(D3) 
-Use an 1/0 bufferí(Carabuffer) 
“Use two integer arrays to re- 
ıcord begin ang end positions 
Oof all palindromes. 
| (Begin-of-palidrome,End-of- 
palindrome) 
-Use other self documenting 
common data: 

(Caralimit, Length-of-text, 
Bufferoosition, Cardcounter, 
Palimdromecounter) 
-UÜse index variables IX,JX 
-Use Local variables as needeci| 


' 
' 
1 
1 
1 
t 
% 
; 
' 
9 
9 
' 
' 
1 
: 
4 | Data Design: 
i 
' 
' 
: 
' 
1 
' 
' 
' 
1 
' 
' 
% 
' 


. 


1/ 
15 


' 
' 
' 
' 
1 
1 
= 
! 
1 
4 
% 
t 
1 
! 
' 
' 
' 
' 
' 
% 
t 
! 
1 
4 
! 
% 
1 
! 
! 
t 
t 
( 
! 
t 
! 
1 
1 
' 
' 
0 
t 
' 
! 
% 
% 
1 
1 
4 
' 
1 
4 
! 
t 
1 
1 
! 
! 
' 
' 
' 
' 
% 
! 
! 
! 
4 
t 
t 
4 
! 
! 
9 
! 
4 
4 
! 
4 
! 
t 
! 
t 


ee ew an pu чәчә bum 2. e. zo ma am a va ma sa 4Ь == ao 2. Фар чәчә bo >. a da o b da nn a Sa ve mn .. $. -. 


<> OD 


e 
3 
Remarks: 

Error 8&1 was made during Step 2. 
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WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEW PHASE OF PROJECT as 1 


: '. , ! MAN ! 
STEP! PROBLEM AND PLANNED SOLUTION | ALTERNATE ¡DAY ¡HOURS¡ERRORI COMMENT 
я! ' SOLUTIONS 'TIME!/STEP} 801 
4 ' ' ! ' : 
S 4Find Palimdromes: ' 11/281 i ; 
'eScan text from left ro right.!-Scan text from $1530! ' І 
'If palindromes of minimal паге го might. |! ' ' ' 
‘length (i.e. length is 2 or 3)!Consider every | ' ! ' 
tare found», call a subroutine ¡character as the! í ' 
"which checks whether or not ‚00ssible oegin- | ' I À 
¡the oalindrome is the center ¡nina of a calin-¡ мМ: 7! ! 
‘of a larger oalingrome. idrome, ' ' ' t 
I ¿Check for all ' 
: ioossible lengths} ' ; 
: ‘going backward І ! 
: if rom the ena of | ' I ' 
' (the tert string, ' i : 
' ¿down tó a 5сгіпо: 1/28; ' 
! ¡length of 2. о. ' ! 
' : І ' ' 
6 | Recoraing of Palinaro^nes: : 117881 i ' 
| -Record a oalindrome only if | ‚1550, ' ' 
ШИ 5 Not entirely included in} ' ' ' 
¡any of the previously recordeci ' ' ' І 
‚palindromes. ' ' ' ' ! 
“lt is also necessary to check! ' wo, 
rwhether any of the previously | ' ' ' ' 
ırecorded oalindromes is en- ; ' н ' | 
itirely included in the palin- |! ' | ! ' 
¡drome last cetected., ' i ' ' i 
¡"A flag should be set to make | ' ' н ' 
iSure that only maximum length ! "1/28. : ' 
‚oalinoromes 411] be orinted, ' 115201 ' 
' ' ! ' | ' 
7 | write all! Palindromes: i ев: ' i 
-Identify the oosition of each! 115201 ' 
ipalindrome by begin and end ' н ' ' i 
with resoect to inout сага i ' ' | 
inumber and position on the J ' ' ' 
‚card. ' ' i ' ' 
¡“Using the position in the ' ' EE ' 
¡text string and the oarameter | ' ' ' 
i; CARDLIMIT the input card num- ! ' ' | ' 
jber and the desired character | ' i ' 
'oositions can be calculated. ' 11/08) i J 
' ' 11630] ' ' 
Remarks: 
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WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEW PHASE OF PROJECT ж 1 


' ' ! ! MAN |! 
STEP! PROBLEM AND PLANNED SOLUTION f ALTERNATE ‘DAY {HOURSSERROR! COMMENT 
' SOLUTIONS TITHE ӘТЕР, 8 ' 

۹ 4 ! ' P ' 

8 i Design Review: ' 11/28: i ' 
‘eInput cards will be stored 12100; ' Forgotten 
‘into TEXT(string array) con= | ' ' ' ı action in 
'sidering CARDLIMIT. ! ' ' ' ı Step 2 
' ' ' ' ' ' 
' % ' ' 4 ' 
| -Preceedinga the writing of tne; ка| ГЕ s 2 ¢} Forgotten 
' recorded oalindromes a prooer i| i ' ' f action in 
‘headline should be orinted. ' ; i ¦! steo 6 (03) 
' (TEXT2) ' ' ' A ' 
't=1f no palinoromes have been | ' ' ' | 
! found» write eauivalent mes- | ' ' ' i 
saga. (TEXT3) : i EID i 
! ! $ ! 4 ! 
| % % , % % 
¡-Design of printout format. н 21728) ' ı See renarks 
: ' 2200. ' 


Remarks: 
Desian of Printout Format: 


Palindrome Begin End 
Number Card Character Caro Character 
Number Position Number Position 
n Dnc бср есп ecp 


<oalındrome> 


Ahere n is the sequence number 
pen iS the carca number of oalimdrome begin 
bcp 1S the character position of calindrome begin 
ecn is the card numoer of palindrome end 
ecp is the charcter cosition of palindrome end. 
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Y 
UT 
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TRUE THEN 


ШЫ СК OVERLAPPING; 
9 


ЕУІ 
TRS 
T; 


° 
$ 


Ë 


RD. PAL INDROM 


C 


69 


CCMNENT MAIN; 


9 


T. CARDS 
3 
NDROMES; 


-INFU 

CK; 
TEXT 
PALI 


ІШЕ 
ChE 
THEN 
ALL 


— 


“сү; 


ب 2¡ 


12 Е 
L W 
CWE 
ITE 


14 CE ЕЕ 
<а<13 Жж 
м ж 
= JL e 
чу WMO 
US U 22 
nt Y O. 01 LL) 





error types) 


coded 


1 


© tof 
COMMENT 
(incl, 


1 


Расе 


1) 
¡ERPOR¡DAY 
я ULTIME 


1/28/2200 


1/31/1220 


* 
* 


PROGRAM PART 


(day/time) 
7.0 (including punching of cards) 


е 
* 


WORKSHEET FOR CODING PHASE OF PROJECT 2 


CODING 


Beginning of Coding (day/time) 


End of Coding 


ANNEX C 
Man hours 
BEGIN 
DAY/TIME 


- 
Y с 
€ о 
с о a 
О с © 
с `= + 
с o c 
а с Ф 
(m D 
с б, г 
€ v -- 
< е с 
x O % о 
t o c c 
De со o 
с о D e с. 
O w nw Е 
Uw -— & = 
v vo > О 
oec о mm e rn t^ -— Ph г өл OONO INI 
wn — O DOD N ny m — + — — — ru — 3 NN — = NN = N 
~ ыы выс “о ово UDO OO 
— 
un e OOO oo о ооо л оо о Un un om o 
om з оомо = м — c TTY rn UY — =m N NM mm y 
N MN нс 53 + un un JO m m m m OO em -- 
fu y مے ہے ہے ہے = 4-- ہے ہے ہے ہے ہس‎ el q t t e > а еф 
м 5 үз оюк © с O = ru rn =+ u О г ODO O — ru rn = 
— — — — — — — — — rv Jn ^J ny 
с 
ос 2 
- O rx D 
bd e- ^ % с 
"-— 8 о о s @ 
c om» ` Ф % > C 
æ N инс Е Ф 
M of а: ..- о Le d о 
4) ~ . = 24 C с 
O @ vw wy ос о а= 
— . 42 О С x € £ 
Фа -xL - u = о 
v e = Ф о — 9 D € 
o c ә зо 2 о г о 2 
Owm zoo а о “O а 
ы! 0 , 
= e о о 
с t^ © гл 
N un m m 
г =! $ = 
ч ч N N 
с) о о о 
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28 
70 


for ounching cards: 


1751/1220 


Mam hours scent 


Remarks 





ANNEX О 


PROJECT #3 : 


1 


Begin of Debug Run (day/time) 


End of Debug Run 
43 of Debug Steps 


CPU time for necessary 


а) 


1.69 


b) 


(day/time) 
in Debua Runs 
comoiles (sec) 


cmo 5 


Man hours for this Deoug Run 


STEP!PROGPAM! OBJECTIVE AND i 
4 | PART! RESULT : 
' ' i 

I ! ' I i 
4 ' ' 

' ' ' 

i ! : 

IE A) | | Get errorfree compile j 
! parts | - 

' ' i 

: ; ; 

! ' ' 

i ' ' 

' ' ' 

' ; | 

' ' ' 

' 4 4 

% ' ' 

' i А 

' i ' 

2 i ål} I Get errorfree comoile i 
parts | ' 

' ' ' 

' 1 ' 

' ' ' 

vo HEN ' Get errorfree compile ' 
ı parts } i 

' i ' 

i ' ' 

' ' 1 

! 1 ! 


DEBUG Run # 


3 


e 


NORKSHEET FOR OEBUGGING PHASE 


: 1 


1751771334 
2/04/1200 
CPU time for Debua 


S51 


е) 


ACTUAL 
PESULT 


ñ comoile 


errors 


2 comoile 


errors 


Page 


f) 


.9 (excluding cverhead) 


l of 4 


MAN 


DAY'HOURS; 


о ТЕМЕ, ГЭТЕР 


1/31 
1355 


rev ous 


m mm mm mm mm «Do Deo am «ке» еке» “е. Do DD bo we we «ка» oe wee we ee oe n e 


run (sec): .02 


g 


ERRO 


D 
34 


55 


) 


1 
R 


) 


oe we ee o cm "D ә Әә «кв «кв m Әә Әр UD =з єз «кез ағат «ке» «- єз ч ӘӘ Әә m "mo чь =з д» ч» =з =з җе m o mom mo 


COMMENTS 

AND CODED 

EPROR TYPES 

1) Record when 
error 
occurs 


А1 
55 
сте 
А2 
tes 
Ec 
e 
А1 


tes 
Ae 


C28 
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WORKSHEET FOR DEBUGGING PHASE 
PROJECT # : 1 DEBUG Run # ; 2 
Begin of Debug Run (day/time) : 27/05/1530 
End of Debug Run (day/time) : 2/05/1500 
# of Debug Steps incl. in Debug Run: 6 CPU time for Debug run (sec): .08 


CPU time for necessary compiles (sec) : 4.99 


E 2.11 b) 1.36 с 71242 a) e) f) а) 
Mam hours for this Debua Run : 1.7 (excluding overhead) 
MAN i) 
STEPIPROGRAM! OBJECTIVE AND EXPECTED ¦ ACTUAL | OAYIHOURSIERROR| COMMENTS 
8 | PART } RESULT | RESULT ITIMES/STEP} = | ANO CODED 
! ERROR TYPES 
| ' ' 11) Record when 
i ' ' ' ' ' error 
' ' н i ' ' ' occurs 
1 {| Utili-i Test al! Texts exect ı Run 205, о. SS Da 
¦ ties | TEXT3 (all texts should ! error пре! 
i | be crinted as designea ) i ' ' t 
: + ' (2705; ! | 
' ! À 420! ' ' 
' ' t ' ! i ! 
2 | Utiliwe; Repeat step 1 ı Run te205 DS TEE STS CS 
ties | Tero 11420) 18 229212527 
; ! | ' ' о 
| ' ' 12799! ' ' 
) | i 11445) ' ' 
' ' ' ' ' : 
3. | Әсіііз! Repeat step 1 t Spacing 2005 0.6 |! ' 
Bries ; ı problems; 1445; о 28 
ECUtili-; Test spacing and orinting! ' ; i ' 
; ties ! of blank lines ' Век. | ' ' ' 
' ! (all formats snould ao- | ' ' ' ' 
' ı Dear as designed) ' ' ' ' ' 
5 | Utili-i Test calculation of num- |! ' ' ' | 
| ties | ber of inout cards for | On, ' ' ' 
' | minmum length of input i ' ; : ' 
' ' string (2 characters) ' ' ' i ' 
: ¦ (program should read on- | ' ' ' ' 
i | ly one сага) ' ' i ' i 
6 | Utili-i Test detection and writ- | ' ' ' ' 
| ties | ing of a palindrome of ' ' ' : i 
1 ı minimum length ' KEV ' ' ' 
! | (oalinarome should be de-! ' ' i ' 
' | tected and listed as de- ! ' i 
i ‚ signed) ' ' ' ' 
' ' | 2705! : ' 
' i i (15001 ' 
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WORKSHEET FOR DEBUGGING PHASE 


PROJECT # : 1 DEBUG Run A 3 3 
Begin of Debug Run (day/time) : 27/05/1500 
End of Debug Run (day/time) : 2/05/1600 


4 of Debug Steps incl. in Debug Run: 5 
CPU time for necessary compiles (sec) : 3.07 
a) 521 b) 1:58 С) с) e) f) 
Man hours for this Debua Run : „9 (excluding overhead) 
МАМ 
STEP! PROGRAM; OGBJECTIVE ANO EXPECTED | ACTUAL i DAYI OURS, 
4 L PART |! RESULT i RESULT TIME ӘТЕР! 
i ' ' i : 
' ' ' ' ' 
i ' i ' ' i 
! ' ' ! : 
1 ; Utiliwt Test calculations of nume; сахо 25 i 
| ties | ber of input cards fer i 209! : 
' | maximum stringa length - i ' ' 
i ¦ (i.e. 256 characters) J к: : 
' i (program should read à ' i ' ' 
' ı cards) i | ' 
2 | Palin-! Test detection ana writ- | i - 
ı drome | ing of a oalidrome of ' Fun 1500! | 
¦ Check | maximum length | error ' ' 
' ' (PALIDROME COUNTE? snoulai! ' ' ' 
' ; be 1, palidrome should pe! ' | 22! 
' ı detected and orinted as | ' 
i |! designed) ` ' ' ! 
i ' ' besos ' 
' ' ' 21250” ' 
' ' ' ' ' i 
5 1 ı Reveat steps 1 апа 2 | ШТИ d | 
4 | Palin-; Test detection and «rit- | S90, i 
(| drome | ing of maximum numoer of | ' ' i 
| Check | palindromes of minimum ' ! i ' 
' ı length ‘ Нок. ' i i 
' ı (PALINDROME COUNTER ' ' ' ' 
' ı should be 125, all 122 : ' i ' 
- | palindromes should be ' ' ' ' 
' ı listed as designed) ! ' } 
$5 | Palin-! Test for string without | ' ' | 
| drome | oalindromes | TEXT3 115501 ' 
ı check | (TEXTS should be orinted)inot orin-!1530! І 
' ' ¦ ted ' ' ' 
! i ' "27/05! ' 
' ' ' 71600! ! 
Remarks: "run error" indicates termination due to excess of a 


13 


COMMENTS 
AND CODED 


CPU time for Debug run (sec): 8.79 


ERROR TIRES 


1) Record «hen 


Cc 


83 
сг 


imi 


error 
occurs 


8 


8 


ts. 
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PROJECT £ : 1 


WORKSHEET FOR DEBUGGING PHASE 


Begin of Debug Run (day/time) 


End of Debua Run 


(aay/time) 


DEBUG Run # 


> 4 


2/05/1600 


2/05/1700 


# of Debug Steps incl. in Debug Run: 


CPU time for necessary 


а) 157 b) 


Man hours for 


STEP PROGRAM} 
4 ¦ PART 


Initi- 
aliza- 
tion 


Palin- 
drome 
check 


e) 


this Debug Run : 


OBJECTIVE AD 
RESULT 


comoiles (sec) 


а? 


2 


CPU time for 


1.57 


e) 


5 (excluding overhead) 


EXPECTED 


Test for inout of 


string length 


illegal 


(program should print a 
„arning and terminate) 


Test for overlaooina oa- 


Iındromes 


(shoula be recorded as 


two calindromes) 


74 


ACTUAL 
RE SULT 


-. ewe caw ew ma aa a oa a a U M 


DAY; 
TIME} 


Page d of 4 


Debug 


i») 


МАМ 


HOURS} 
И ТЕР, 


run (sec); .22 


COMMENTS 
AND CODED 
ERROR TYPES 


1) Record 4nen 
error 
occurs 
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ERROR LISTING 


PROJECT %4 : 1 


Begin of Project (day/time) : 1/28/1040 
End of Project (day/time) : 2/06/1620 
Man hours for total project : 21,8 
ERROR! PHASE { PHASE | ERROR : TIME | 4 of OTHER 
8 Eun which; in which: ТҮРЕ Isoent to |! STATEMENTS DR 
¡ERROR was! !ERROR wasi (see ANNEX F) "solve the} PARTS OF THE 
' dis- i "ade | | ERROR I PROGRAM 
|! Covered | ı (Man AFFECTED 
' | min.) | 
i ' ' ' À 
1 ı Design ı Design ! 03 i S ¡Data inout cnly 
2 1 Design ı Design ı 03 ' = ¡Data printout 
Codina | Coding ! C23 S IIndexing within 
' ' ' ' (subsequent sub- 
i ' ' ' i routine 
Coding ¦ Coding ! С25 : 3 i 
Codina ; Coding i: C10 : 2 ' 
coding , Coding ı CB 5 : 
Coding ¦ Coding i Co ' > ' 
coding i Coding ! C23 i 5 ' 
Coding ¡| Coding ! C23 ' 10 13 Statements 
10 | Coding |! Design ! 03 ' 30 ¡Añole subrou- 
' ' ' ' ıtine affectec 
ЖЕН Coding : Coding i СІ ' 10 ¡Whole subrou- 
' ' ' i 'tine affected 
ШОТ Coding | Coding ! СІ! i 5 
EN Coding | Coding |} C11 ' 3 i 
п OGiIing | Coding ; Cl? : 5 ' 
Coding Coding | C27 ' 5 
ШТ Coding | Coding i CIS 5 
meer Coding | Coding i! C4 J 5 
Ei Coding | Coding ¦ C20 : 5 
EN Coding | Coding ı C23 ' 5 ' 
Moms Coding | Coding | C12 : 5 ' 
E Coding i: Coting ! С19 i 5 ' 
EE Coding i: Coding ! C24 ' 10 ' 
EN Coding | Coding | C12 ' 3 ' 
II Coding | Coding ! С24 ' 15 ¡Nhole subrou* 
' ' ' ' Itine affected 
SS Debugging! Coding ! Al i 10 ! 
! ! ! i + 
І ! ! ' 1 
26  iDebuggingi Coding |! CS ' 5 і 
27 ¡Debugaing! Coding ! С12 3 


ЕГЭ 





ANNEX El Баса 8 707 2 


ERROR LISTING 
PROJECT # : 1 
Begin of Project (day/time) : 1/28/1040 
End of Project (day/time) : 2/06/1620 


Man hours for total project : 21.8 


ERROR! PHASE : PHASE i ERROR ' TIME | 2 of OTHER 
DA which! in which} TYPE ¡spent to i| STATEMENTS OR 
¡ERROR wası ERROR wası (see ANNEA F) solve thet PARTS OF THRE 
' dis- | made | , EPROP ' PROGRAM 
ı Covered | ' ‚ (Мап АРРЕСТЕО 
i impe 
' ' ' ' ' 
28 ‘Debugaingi Codinq ! А2 ' 5 ' 
A Debugainai Coding i: C25 ' 3 
E Debpuggingi Coding i Cle S і 
! i t i ' 
31 iIDecugging! Coding ! СІ! І 3 i 
32 ¡Debugaing! Coding ! А! i 3 ' 
m Debugqgingi Coding ! С25 ' 5 н 
34 {Denuaging;: Coding 1 А2 ' 5 ‘ 
55  iOebuggina:i Desian ! C28 ' 10 ! 
36  iDebpugaing: Design ; 011 225 ' 
NA Debuggina: Coding ı C8 | 10 iweitina of ра= 
' i ! ! 'lingromes 
38 iDenuaging! Coding ! С27 S ! 
39  jiDebuggingi Coaing ; C20 ' 10 ¡Nriting of pa- 
' ' ' ! ılindromes 
40 ‘Debugging! Coding ! С28 Қ” 20 hole subrou- 
' ' ' ' ıtine affected 
41 ¡Debuggina! Coding ¡ C28 I 15 
42 ¡Debugaing:Debugging: 83 i 3 ! 
43  iDebugaingi Coding ! С28 ' ШЕ ' 
44 i Testing | Design ! 09 і 290 | 
' ' ' 





АММЕХ Е2 Page 1 of 2 


ERROR LISTING (COMMENTS) 


ERROR! DAY | COMMENTS 
# ! TIME! (EVIDENCE, THOUGHTS, HY WAS THE ERROR MADE? 
: ! WHY AND HOW WAS THE ERROR DISCOVERED? 
| ; ERROR BLOCKING, etc.) 
ШІ 1/28) 
1 ' ı Lack of concentration (step left out, which the programmer 
' 1505; was aware of) 
2 1 2115; This design step was costooned and foraotten later on. 
3 | 220051 Programmer dia not cnecx« the manual, (Oiscovered while 
' ' examining the solution of a samilar proolem in an old proaram.) 
а 1 2210; same as 3 
7301 
S |! 1240) 
6 ! 1400) 
ШЕ 13051! 
3 | 1420! trror «as found while examining the list of error tyoes 
' ! in connection «ith errors 5 and 4. 
9 ; 1500: Error was found e«hile reagina the programming manual. 
E 1510; Errors 10 and 1l discovered curing a cesk test. 
mime, 16350; see 10 
12 ; 1710! (wrong indentation could lead to programming errors) 
ВВ: 1710; зее 12 
E 1720! 
E 1725! 
251! 
Et 1030! 
17 ! 1050! This statement was inserted between the wrong lines. 
' | It was detected in this early stage of the project 
' ı because the programmer was ounerina cards himself, which 
' | allowed him to review his source statements. 
18 1 1110; Programmer did mot look at the declaration of the variable. 
ES 1115 
20 | 1120]; (missing mandatory declaration) 
E 1125!) (wrong format) 
ES 11305 
23 ı 1135: same as 20 
24 ! 1140! 
ШІ/21! 
eS 1 13351 soecial character (") was expected to Бе necessary due to 
i ı similarity with other uses of NRITE/WRITEON, however this 
' ! assumption was wrong 
26 } 1335i (previously declared variable declared twice) 
27 | 1335; same as 20 
ESOS 1535) 
09 5 1335; Programmer did not check the programming manual. 
BENE 1335! see 20 
BINE 135535; 
BE 1335; 





АММЕХ Е2 

ERROR; DAY | 
EE TIME! 
! ' 

i i 
ЖЕ 
ШИ! 1806! 
ӘШ 1806; 
t 2/0401 
E 112e! 
' ' 

‚ 2/05; 

36 1 1349, 
Byes 1420; 
ЕЙ 1420; 
39 1420: 
Іі 2/05! 

40 | 1435; 
2/05! 
41-1 1500) 
Memes 1550} 
Bo 1550; 
E700] 

ча ; 1525; 


Page 2 of 2 


ERROR LISTING (COMMENTS) 


COMMENTS 

(EVIDENCE, THOUGHTS, wHY WAS THE ERROR MADE? 
WHY AND HOW WAS THE ERROR DISCOVERED? 

ERROR BLOCKING, etc.) 


Error could have been avoided by looking at previous block of code. 


Porgrammer had correct design conceot but did not coge 
correctly. 


Boundary con3itions had not been checkea before, 


Trivial error «as made, cecause orogrammer was tired. 


Design was not stated well. 
same as 40 





АММЕХ Ғ FINAL STATISTICS 


PROJECT 3 71 


FINAL STATISTICS 
Project nare : PALINDROMES 
Short description: 

Given an input String of length n, «here 2 <= п <= 256, 
fina all occurences of oalindromes and list (лет with 
respect to their beginning and ending positions on the input 
сага. 

Inout: vıa punen cards 
Qutout: via line printer 
Suantitative measures: 
1. 5 of source statements : 141 
2. Total man hours for oroject : 21.8 
3. Man nours soent in 

a) Desion : 3.0 

BJI Coding : 7.0 

c) Debugging : 4.0 

ay Testing : 5.8 
4. CPU time for comoiles: 20.22 sec. 
5. CPU time for debug runs: 9,11 sec. 
5. CPU time for test runs: 13.98 sec. 
7. # of test and deoug runs: 5 
8. 8 of test and debug steos: 23 


9. 8 of errors found: 44 


10. Total man hours used to correct errors: 6,73 





АММЕХ Е FINAL STATISTICS 


11. Error Detection: 


a) Mean time between error detections: 20.3 man min. 


2 of 
Errors 

n 
' 

29 !"хххххаж 
1 * 
1 * 
: * 

20 + * 
; ж 
1 * 
І ж 
H ж 
+ ж 
i * 
I * 
! * 
! * 
I * 

10» ж 
: kw xk x 
: * * 
i * * 
) * * 

5 + * RAR RR 

J * * * 
i * * * 
| ж ж Жей XK XK 
ж ж ж хжжжхях TER Xx wo x 


------)-----%-----)-----%ееее-%е------)-----)-----% ,,, %----- ---> 
0 -15 16-30 31-45 25-60 61-75 76-90 91-105 105-120 151-175 тап тіп. 
of 
project time 
TIME BETWEEN ERROR DETECTIOMS 
(measured from coint in time of detection of previous error) 





ANMEX F FINAL STATISTICS 


12. Error Correction! 


a) Mean time to correct an error: 7.8 man min. 


2 of 
Errors 
corrected 
t 
' 
t * 
| * 
20» ж 
1 * 
) * 
i * 
е * 
15+ * 
i * 
: * 
l ж 
, * 
19+ * 
i ж 
i * 
l * ж ж 
| ж * * 
$ + * * * 
I * * * 
* ж ж ж 
1 з * * * ж 
li * œ * ж * ж * * 
%”%”%е%е%ееет---е---фе--е--ее-с---і-----с----)---------)---------)---> 
QE cds 10 159 20 es 50 


man minutes 
of project time 
TIME TO CORPECT ERRORS 
(measured from point in time of detection) 





ANNEX F FINAC STATISTICS 


13. When errors were founa: 


I 

a) # of errors found during design phases J 2 25 
b) 3 of errors found during design review: 1: 2. 
c) 8 of errors found during coding: ege = SÛ. 
d) # of errors found during debugging? 19 = d3, 
е) 8 of errors found during writing of 

test orocecures: = 0 
f) 3 of errors found during testing: l= res 

44 


14, Nhen errors were mage: 


а) 2 of errors made during design phase? S = I1. 
D) 3 of errors made during design review: = (Фф, 
C) 3 of errors mage during codina: а = 66. 
а) 8 of errors made during debugaing: pez 2. 
e) 2 of errors made during eritina of 

test procedures: OS 20% 
f) 3% of errors made durina testina: жау? 

44 


25 25 4 


e 


#4 


at 2 of ¿$ 


et 





АММЕХ Ғ FINAL STATISTICS 


15. TIME HISTORY GRAPHS : 


# of 
Errors 
7 
' 
i Еггог Types: 
i As Clerical error 
' B: Depugging error 
! C: Coding error 
' D: Design error 
8 + А 
' С 
' С 
S * C À 
' CPC 
' Е С СЕЕ С 
: C E C pop c4. C B 
l + D DOWECCCCCOQEEGC TACOCCCC 0 
-%-%-%-%-%--------- %------...- %---------%---------- > 
І 2 5-4 5 10 15 20 man hours 


ООШ ЕБ СОП Сола... .....бебосотла. esting- 
(Software Development Phases) 


NUMBER OF ERRORS FOUNN VS PROJECT TIME 


B of 

Errors 
1 
à 
! 

5 + x 
: А 
t * я Ax 
5 жж ж # e+e kek ХХ 
: * *xX kx RRAK *Xo* Ro e o d de Ж Ж яя 
Ó + =» + @ + ы о чо чә чә - чт oo oo o w w x x ooo o m Jana ao чо «о ca ев > 

12 345 10 15 20 "àn hours 


NUMBER Of ERRORS CORRECTED VS PROJECT TIME 





ANNEX F 


l. 


2. 


Desi 


ERROR CATEGORIES AND TYPES 


gn Errors 


The follwing types of errors acoly to both categories 
"System Design Errors" and "Program Design Errors": 


Codi 


O 
un 
ee eo. se e. e. 90 ее есе ев 


Communication Error 

Design Negligence 

Forgotten Cases or Steps 
Timing Problems 

Errors in I/O Concepts 

Data Design Error 
Pat ial wat on Error 
Inageaquate Checking 

Extreme Conditions Neglected 
Sequencing Error 

In3exinc Error 

Laos Control Errors 

“isuse of Joolean Expression 
Mathematical Error 
Reoresentation Error 
Misungerstanding of Proolem Specifications 
Other Desian Errors 


ng Errors 


су 
л 
эе 006 Фе зо ot 90 bo ее ео 


Misunderstandiro of Design 
Negligence 

I/O Format Error 

Misplaced Data Declaration 
Multiole Data Declarations 
“Missing Data Declaration 
Inadeauate Data 

Initialization Error 

Error in Parameter Passing 
Inadeauate or Forgotten Checking 
Level Problems 

Missina Declarations of Block Limits 
Case selection error 

GO TO Problems 

Comment Error 

Forgotten Delimiter 

Inconsisteney in Naming 

wrong Use of Nested IF Statements 
Indexing Error 

Inconsistent Use of Variables or Data 
Sequencing Error 

Flag Usage Problems 

Syntax Error 

Loos Control Error 

Incorrect Exit from Subreutines 
Language Usage Problems 
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сет: 
Сга: 
C29: 
C30: 
ESI 


3. Clerical 


un, Depugsging 


Bl 
Ве 


ERROR CATEGORIES AND TYPES 


Forgotten Statements 
Representation Error 
Control Seauence Error 
Incorrect Subroutine Usage 
Other Coding Errors 


Errors 


Manual Error 

Mentai Error 
Procedural Errors 
Other Clerical Errors 


Errors 


Inacorooriate Use of Depugging Tools 
Insufficient or Inacorooriate Selection 
of Test Cases or Test Data 
Misinteroratation of Debugging Results 
Misinteroretation of Error Source 
Negligence 

Other Debuaging Errors 


5, Testing Errors 


Inadeauate Test Case(s) or Test Data 
Misinteroretation of Test Results 
Misintercretation of Program Specification 
Negligence 

Other Testing Errors 
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ANNEX С 


OIRECTEO GRAPH REPRESENTATION 


l 


PROJECT 4 


: INITIALIZATION 


Program oart 


COMPLEXITY MEASURES 


13 


WUMBER OF STATEMENTS 


7 


5 


ж 
-æ 


ы) 


с) 

NADO N> 

.. 

тш 

.. us 

Uv Wa 

uiv? 13. 

OO eD 

Un az 
“і а 

Ue 

ии ur 

U U 

< 

(УСК mx 

WUW U 

00 me. 

22 20) 


Serer 





OU AT UY 


FAEILITY CF 


с 
Е 
Е 
c 
Е 
Е 


"AUC)COC)CAC) 





ry) 
о 
e 
O 
MP. 
T 

т 
= 


86 





АММЕХ 6 Pane 2 of 


OIRECTED GRAPH PEPRESENTATION 


ENDJECT = < 1 


Program oart : BLANK LINES 


BEOMPEEXITY MEASURES: 


NUMBER OF STATEVENTS: o 
NUYB ER CF NCCES: Š 
МШЕ ЕК СЕ Ан : 5 
NUMBER CF FATFS E 
БҮСІСМАТІС NUMBER: Vi 
REACPABILITY CF NCCES: 
NOCE DE: 1 
ШЕШСЕ 22: 1 
NOCE 577: 1 
К@ Ес 4 : 2 
ШЕГЕ Е: 1 
МЕСЕ ° 2 

SUN: Cn gcc 
ШЕСЕРАЕТІГІІТҮ INDEX 
ЕЕ ОІЯ-СТЕГ GRAFH: 
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DIRECTED GRAPH REPRESENTATION 


ESDJECT 3 : |1 


Шасагат part : TEXT], TEXT2, TEXT 


ЕНШТІБЕЕХІТТ MEASURES: 


EBEN OF STATEVEHTS: d - 11 
NUMSER CF ACCES: 2 
NUPSER CF secs : 1 
NUREER CF FATFS: 1 
MATE MATIC NUNS ER Vig l= 1 | 
EECCHABILITY Cr NCOSS: 
NES 1 : у 
МӘСЕ 2 : 1 
SUM: - mu SQ 
ЧЕАСРҺАРТЦТТҮ ІМСЕХ 
CF DIRECTED GRAPE ES CIGE 





DIPECTED GRAPH КЕРРЕЗЕНТАТЕОМ 
BROJECT = : | 


Proaram parr : READ AND APILTE INPUT CARPNS 


ВВЕРХ [Туи MEASURES: 






NUMBER CF STATEMENTS: 18 
ее“ Cre ACCES 9 
NUMBER CF ARCS 1 
NURSES EE FATES: 5 
БҮГЦСУАТІС МҮУУЗ8ЕС Y(G)= а 
ЧЕ ОГ РАЕВ Т ТҮ СР NOCES: 
NECE 1 : l 
МЕСЕ 2 2 é | 
NECE E : 6 w 
NCCE а 3: 2 
NCCE 5 : = 
МОСЕ 6 : ё 
SUN: desto € @ | 
Ruc ZC pa a iL ITY INCEX 
ELODIRECISU GRAPE: cs 





£Mme xXx 6 ad SOE 9 


OLRECTED GRAPH REPRESENTATION 
PROJECT > : 1 


Шсапап озгі : «SITE ALL PRILINNRORMES 


ӘШ 5 of moges: 15 
pz 9f arcs : 19 
EI of statements: 2o 
er = af gatas 
a) 5 әзсчтаотіт-у: 


$) Cvelomarie nunoer! o 


« üumber of patns © 
ang regcnao!'lity 


are verv large, 


. ж 
Ө (~) 1 t © 
i i 


Error 
Error 5 


и 


Coe | 


s n 


14 


مم 


O 





ANNEX G Расе 5 of 9 


DIFSECTED GRAPH REPRESENTATION 
PROJECT = : l 


Program oart : PALIMNDROME CHECF 


vi 


a) of nodes: 10 
202 5f ares 3: 15 


= or statements: 7 


ы 


c) еее: * 

e) Reacnaoility: * 

E Cyclomatic numcer: 5 
* Numoer of patns 


ang reacnao!l!'*y 


are very larce. 
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DIRECTED GRAPH 9EPPESENMTATIOM 


БЕШ ЛЕ Т 2: 1 


Program oart : CONTINUE CHECKING 


GOWMPLEXITY MEASURES: 


NUMBER CF STATEMENTS: 15 

NUMBER CF NCCES 3 | 

ПЕУЕ 55 CE ARCS : 9 

MUSSER CF FATES © 
CYCLCYATIC NUMRER: V(C)= 3 


Jo 
in 
l> 
о 
E X 
+ 
CD 
.. 
г 
ba 
4 
е 
Са 

là 
== 
С) 
С 
fi 
4% 


NOCE l : i 
МЕСЕ 2 о 7 
NOCE 2 : € 
NCCE 4 4 E 
NCCES © ; E 
NG CS é é 
AGLE 1 : 7 
Nene € : 1 
SUM: Q. COCOO 
A raciLITY INCEX р | 
SET DIÍZSECTEC СААРЕ = .CeGcec 
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МНЕ ПЕН CRATES REPRESENTATION 


PROJECT =z `: l 


Proaram oart : RECORD PALINDPOME 


n 


а) at посев: 9 

Е of ares : 12 

c) 5 о? statements: e! 
РЕЗ СЕ Sains: 

Б сезспаотіт су: + 

ШІ Гусісзтатіс гпотсег: 5 
unger of sats 


anc reachani lity Zh 


are very lar^e. 


e Error 
a ND 


OLY, 





ANNEX G Pace 9 of 9 


DIRECTED GREPH REPPFSENTATION 
PROJECT s ; l 


Program oart : MAIN 


ШЕРЕЕХІТҮ MEASURES: 


USER UE STATEMENTS: o 

NUMSER CF NCCES: е 

Е СЕКС :; S © 

^ UNRER MD ST 2 

А КЕГСУАТІС NUMEES 3 У(С) = 2 его fo ds 

REACHARILITY CF NECES 

NOCE l : 1 

NGCE 2 D 

NCCE E 1 

NCCE 4 I 

NOCE 5 2 

NOCE é 2 © © 
SUM: 8.СС00С00 

EEGCPABILIIÓIY INCEX 

ШЕ ЗЕСІСІ GRAPE 


юе 
. 

der 

tu 

ім 

ou 

іы 

C» 





ANNEX H 


TEST PHASE DESCRIPTION 


Project # 5 1 


Test run £ 3 1 


Begin of Test (day time) 


CPU time for necessary 
ا‎ b) TIE) 1 


CPU time for TEST run (s 


Including 


: 20/06/1430 


End of Test 


Page | 


7 Test Steos 


compiles (in sec.): 5.18 


Така) е) 


ec) :.13.98 


f ) 


Man Hours in Testina : 5.8 (including oreocaration 


EESTI 
STEP, 


51 


Notes: 


BEJECTVE 


' 
' 
Check program fori 
small palindromes, 
(а) palindrome ofi 
lenath 2 
(b) palindrome of 
length 3 
Check for large 
palidromes 
(а) calindrome of 
langth 255 
(b) palindrome of 
length 256 
Test correction 
Repeat steps 1,2 


Test correction 
Reveat steps 1,2 
Check oalindromes 
which cross cara 
boundaries 

Check for calin- 
dromes of various 
lengths and sizes 
Check for invalid 
input (string 
lenath = 1) 


EXPECTED 
RESULT 
(TOLERANCE) 


41) oalingrones 
are cetected ard 
recorded as sce- 
сіҒіес Бу ого” 


дгат scecifi- 
cations 


Same as 1 
Should be deo 


dected ana prine 
ted as specified 


Same as 5 


Warning anc сег” 


mination 


(ACTUAL | 
¡RESULTA 


progr. 
error 


job 
termi- 
nated 


ou ua ow oo coe mo m zz za zu za Sea ӘӘ RUD ceo XD D o m b Ҹә аә аһ чә Әә аә «коз «ке» әке» «ев mn eo ee 


of 2 


(day/time) 


g) 


of tests) 


1) 
ERROR 


b 
-æ 


ад 


Other invalid inouts were exhaustively tested 


debugaing phase. 


95 


(DAY | 
ı TIME: 


2/06 
1430 


545 


1550 


== == zo vo za za co vo ma ч» we =з = шз a SBS db db ea =o ә ҹә =з =з © == mn m zn mn mu mm mm 


оо 


during 


: 2/06/1620 


COMMENTS 
ANO 
CODEO ERROR 
TYPES 
1) Record “hen 
error oCCUFS. 


09 


Imolementation 
error (time 
estimate exceeded) 


See notes 
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Choice of Test Data: 
Some test data «ere chosen to check the program for boundary 
conditions. Other test data were selected to check random 
size and numbers of palindromes. 





APPENDIX B 
PROJECTE DESCRIPTION 
Eroyect 25 : 2 
Beer titles PATH ANALYSIS IN DIRECTED GRAPHS 
Programmer : HOFFMANN 
Programming Language : ALGOL 


Programmina environment: 18M/360/67,0S/MVT,BATCH 
and TIME SHARING (CP/CMS) 


Design notes : see ANNEX A 

Program listina : see ANNEX B of APPENDIX C 
Coding notes : see ANNEX C 

Debuggina notes : see ANNEX D 

Bor Listina : see ANNEX E 

Final statistics : see ANNEX F 

Graphical reoresentation : see ANNEX G 


Test phase descriotion: see ANNEX H 


Peart yng date: i MAR 77 ЕПС date: 1/ МАН 7] 


КОРЕК ЕЧ К DESCR ] Fr een 


meerroject description: 


A, General Description 

This program is designed to find and «write all oossible 
Bot minimal lenoth (i.e. if a directed graph contains 
loops, no looo may be traversed more than once in succes- 


ENDO throudh a directed graph. 


Ec =» 





Wout Description! 

fey Batch Processing : 

Erg i: 1 in card column 1 followed by any text 
(this text will identify the graph and will 
be printed as a headline preceding the input 
documentation) 

РЕСОР: t in card column I followed by one blank, 
where t specifies the type of bath listing 
desired. 
t=0 -» al] paths are listed during analysis 

(recommended only for a very large 
numbem of paths, т.е. more than 500 
caths expected) 
t Is nonzero => paths are listed after 
analysis has been completed 
(any additional information wil] 
rot be interpreted by the program) 
МӘГІ 5: s in carc column 1 followed by one blank 
aneres Specifies the number of dqiqits 
of the laraest node name used in the directed 
graph and 1<= s <33 
(any aoditional information will not be 
interoreted by the program) 
Card u: 1 n sl se = sn 
where 1 iS the node name of the entry node 


and may be punched in any column 


- 98 - 





n is the number of successors 
and 0 <= п <= 14 
бі (ігі,2, ... п) Specifies the name 
of the 13th sucessor of node 1 
mara 5 theu Card mt3: 
where m specifies the number of nodes in 
in the directed graph 
Format: j n sl 52 TT sn 
where j specifies the node name of the node 
being described on this card 
апа 2<= 4 <= 999; j may be punched 
о ату column 
n 1s number of successors 
апа 0<= п <= 14 
ОЕ, ... n) specifies the name of 
the iths successor (1 <= sà <= 999) 
if n=0 => no entry necessary 
DOTE: 
(a) All entries are integers and must be separated by at 
least one blank. 
(b) All information about any node must be on one card. 
(c) Card column 80 must contain a blank character or ап 
additional blank card has to be inserted. 
Mara 4 + з: 99999 followed by at least one blank 
MS ІШЕШЕ indicates that all information of 


the oreceeding directed graph has been input) 


05 2 





E Following this description any number of directed 
graphs may be specified and submitted to the program. After 
the last descriotion cf a directed graoh a termination card 
has to be added which contains any integer different from 


Eun card column |. 


Sample Input: 


1 (FIRST GRAPE) 
0 TOGGLE 
2 МАХ МОБЕ МАМЕ 
1 1 e 
2 2 3 4 
5 0 
4 1 5 
5 0 
99999 
1 (SECOND GRAFH) 
1 TOGGLE 
1 MAX NODE МАМЕ 
1 2 5 2 
2 0 
3 1 4 
4 2 1 5 
5 0 
99999 
- | ТЕГ i NA Te 


Input under CP/CMS: 

The input seauence under CP/CMS is similar as under 
batch processing. There is only one exception: Any other 
Inout than the input requested by the program will terminate 
the orogram. The user can only input integers, additional 
blanks are not alloweo. 

Under CP/CMS instructions are displayed at the terminal 


which makes the use of the proaram almost self-explanatory. 


= 000 = 





NOTE: 
в (осіп with 540к 
(b) Follow the directions of the program orecisely. 


(c) Input only integers. 


C, Error Messages: 

All error messages are self-explanatory. 

E ors 5, 8, 9, 10 refer to invalid or incomplete input. 
errors 8 and 9 will cause the program to terminate. 

Ж ИЕ 2 Indicates the limit of the program. If error 2 oc- 
curs it is most likely that the directed graph has an infin- 
ite number of paths. The user may try the same input using 
Mees input on the second card. Error I will only occur if 
more than 30 nodes nave been specified having 14 successors 
each. 

All other errors will indicate an error which has not 
K found during testing and debugging or will be due to 
Some abnormal usage of the orogram. la either case vt might 
be possible to locate the problem by examining the program 


listing or retrying the orogram. 


= bb 





Oct 
May 


May 


Programmer's background: 


a) Experience in programming: 
1970 = May 1971 Proaramming courses 
1971 - April 1972 Module Programmer 
1972 - June 1974 Work in Test and Simulation Depart- 
ment ət the 
- NAVAL COMMAND AMO CONTROL SYSTEMS 
COMMAND (FEDERAL GERMAN NAVY) 


Testing of tactical real time systems 


KE 1975 = Jan 1977 Student at the NAVAL POSTGRADUATE 


SCHOOL, Monterey, Computer Science 


b) Experience in testing: 


Pwo years of work in testing and simulation. 


с) Experience in the area of the given problem: None. 


d) Experience in the proaamming language being used: 


Experience over а period of 18 months in more than 10 


programming orojects. (Total number of source statements 


oroduced during that time was more 4000.) 


3. 


meavyenological factors: 


a) Did the programmer like the project? Yes. 


b) How does the oroarammer like the programmina 


= ПЕ = 





language? 


Favorite programming language. 


C) Was the programmer satisfied by the way the problem 
was specified? 


ELI V minor criticism. 


d) How did the oroarammer like the programming environ 
ment? 
ime facilities (study room, card punch room) меге not 
conducive to efficient programming because of restricted 
space, bad lighting and noise. 
ЕЕ Псһег factors: 
The recording of the experiment's data during the proe- 


ject affected speed and concentration considerably. 


cO > 





4, Comments on Documentation 

For the documentation of each software development phase a 
special documentation form has been developed. These forms 
are designed to provide a firm quideline for the experiment 
programmer to record all data of interest for subseauent 
error analysis. 

- Begin and end of each steo was recorded with respect to 
day and time. 

= Each error was recorded when it is discovered. The error 
was then identified by а unique error number (1,2,...). 
Furthermore the time of discovery and the error type (using 
error tyces listed in ANNEX F) were recorded. 

- ]f aoprooriate, comments about error discovery, reason why 
the error was made, etc. were documented in ANNEX Ee. 

- For each error the phase in which the error was made, the 
phase іп which the error was discovered and the time spent 
to correct the error was recorded in ANNEX El. 

= For each step in any one of the software development 
phases the day/time of begin and end was recorded. In addi- 
стоп, the time (in man hours) for each step was recorded. 
This excludes the overhead used for documentation of the 


experiment data. 
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WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEW PHASE OF PROJECT s 2 


' 1 1 t MAN 1 ' 
' 4 % % ۹ ' 
STEP! PROBLEM AND PLANNED SOLUTION ; ALTERNATE (DAY FHOURSSERROR;, COMMENT 
8 |i / í SOLUTIONS TIMESTEP. 4 | 
1 lAnalyzing structures with 2/01! 
‘respect to minimum number of 1900! 
ipaths. ' 


‘The minimum number of paths 
‘includes all oossidle oaths 
‘starting at the entry noce (1) 
land ending at any node which 
Ihas no successor. The minimum 
inumber excludes all paths hae 
iving repetative traversals of 
1100065, such that any sequence 
sof arcs is traversed nore than 


7 


once in a row. 2/03! 
2400; 
! ! 
$ ! 
2 (¡Design of Data Structures: 3/04; ¡Details 
' 11001 isee 
' 3704! ¡Remarks 
' 1900! ' 
Remarks: 


Two freelists are used to sucoly storage space to keeo information about 
paths and the structure of the ungerlyina directed graoh. 


EREELIST 1 (M1) 
(451 Items of 4 bytes each (32 Bits)) 
Items 
used for: 5 
Bytes > < 2 Bytes 


A 
fu 


м 


а) 
Successor 
Information 
(element 

in forward 
linked list) 


successor name 


ptr next successor 


ws чәчә oo oo oo 
e чәчә a. == u y 
== uw 2. m o 


b) 

Header of 
Successor 
list 


! 
% 
reachability oarent | otr successor list 
! 
4 


E) 
Freelist 
Header 
(Item 0) 


° 
A o o o Чр чэ чю чә чә ер чэ чә ê o э «ә Р i АХ 


% 
i 
! 
۹ 
0 iotr next free item |! 
f 
% 


БОБ = 
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FREELIST 2 (M2) 
(20001 Items of 8 Bytes each (64 Bits)} 
Items 
used for: 


A 


2 Bytes > < 2 Bytes > 


а) 

Моде 
Information 
(duplicate) 


+ $». aaa 4D D чэ «D «D D C um» D m m «ғә «ғ «b UD D ч D Cb «D SD aa ub D ub «ә «Әә «ә. 


pointer to original 


«m «p «D cb D Ob «D Ub WD Ub «D D o чо чо Do «D a» C em 


mode name 


«m «D «ро «ә «ғ «ғ аю аю ер «ә "D Ob ub XD oU» «ғ =й a» UP od 


otr to oregecessor 


ер ер ер ер ер ер ер «о «ғ «ғ «аю ер е? «ә «ә «Ы «ә» «Ә-Ә 


ptr to successor 


ee «ғ b ub wu XD ер ер ер ер ер «о ер ер аю «ы |» o] 


== P ow "b o чә чә ow 
== == еч ғ ығ Y 


о) 
Pathheader 
Information 


a b а» «ғ «ғ b ер ер =й ub ub XD XD XD XD XD o =» em 


cath identification 


о ер «ә ub "UD b D ub D «D XD D D XD um o o o «ә р 


ctr to next oath 


- D D ue D ub «ы «ә ub D Ob D «D D Gb ub ә чо «эю cm 


ptr to Previous path 


WA «DP =й «ғ D D «D UD D uu» S «ғ «о WD ш р ер 


ptr со бесіп ОҒ path 


AAA Aa 4D a XD «D XD D ub =й «ә oa» «ә 


С) 

Моде 

Моде 
Information 
(original) 


oue e bo» bo» "DoD - «D Cb «D =й D р ер b o e «ғ b "DP "D ub Ob m «о «D ub "UD D D ub a Da» з 


' 
I 
pointer to original inoce name 

«ер «D eb «ғ ub XD uo D um «ғ аю D «ғ «ғ ер b b ow ow : ж «ағ аю «ғ «ғ «ғ «ғ «ғ «ғ «ғ «ғ $e «ғ «ғ «ю ер «о «ә 
! 


+ of successors ‚otr successor list 


+ ер A ub cub CD qp D «p D qp «D ub UD a "D oum 


«ә Dow "D e D ер «ә e ub SD WD D ub DD DS ер 


i 
d) 
Freelist 
Header 
(Item 0) 


- «DP «ә «ә «ә ub ub XD Ob Ob wu» ерер ер «D "D еә еэ р ер “ «ә p р D «D ч oo ooo e eo o o o © o 


; i 

| ! 

NE о 
--------------------!--------------------. 
| 


0 iotr next free item 


Wa A DA DA «D "D еә «D D D «э э «ә р ' wo eo o oe «эеэ «э чэ чо «э чо «XD XD D m m a з 


> - 
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Typical usage: 


a) Oriainal node with successor list 


' ' 

' i! 
' ' 

' 


b 
b 
b 
! 


! b 
nipt F = @ @ @ @ @% о @ ج‎ 


b 
! 


Where; 
is j; k are noce names 
r represents reachability of node i 


о is the storage location within "2 
NIL indicates the end of a linked list 
р) Doubly linked list of path headers: 


+1 


! 
b 
» r4 
% 


! 


+ рег Dit гооо ое о © 4 ote 
! ! b ! ! 

' ' 

' ' 

V V 
beginning beginning 
of oath 1 of Sath i+] 


Ahere + апа i+! are path 


! 
' 
of 1 


' 
Коке 
і 
i 


of j 


= == = o. == == 6 


= 6 == = еә 


! 
3 
|! ptriotr-- 
! 
y 


here i and j are successive 


1 
% 
! 
Ц 
! 
! 


identifications. 
с) Nodes (duplicates) being elements of а 
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)ipntr2-22-2-2--»5 


path 


fT predecessor of node 1 
' 
y 


nodes on a oath. 
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WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEW PHASE 


| 
STEP} PROBLEM AND PLANNED SOLUTION ¡ ALTERNATE 
н |. SOLUTIONS 


3 iTOP = DOWN Design: 
'Define the following program 
‚parts: 
¡“Data structures 
¡“Primitives to support cata 
¡structures 
¡“Utilities to suooort data 
¡structures 
ı«Logical orocedures to suooort 
¡analysis of directed graohs 
¡“Subroutinmes to support analv- 
isis of oossible oaths through 
ia directed graon 
ето? оѓ data 
i"Üutout of data 
ı=Error messages and relevant 
(diagnostics to suoport error 
¡error investigation 


= Ыш 


of 5 


OF PROJECT 


ı MAN 


4 O 


ھم 
. 
eo‏ 


wu mm mon UD dm 4m "D dm ҹә чт =з Әә ә "D "D чә аә чә wb Әә WD am ә Әр сә шә =з аә чә аә Әр ow 


3/05! 
1500! 


4 


ee we on A р ч DA o b so zo zo go co zo za zo sm va nn D 


2 


t 

, 
AY ¡HOURS¡ERROR; C 
ІМЕ!/5ТЕР) ' 


# 


ee ef =з dm ow co bu ws a Da ss oa sa as e dm UO dm ub ә Әә аә аә o ew 


OMMENT 
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WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEW PHASE OF PROJECT # 2 


у ‚ МАМ 1 Ж 
STEP} PROBLEM ANO PLANNEO SOLUTION j ALTERNATE ¡DAY ¡HOURS¡ERROR; COMMENT 
8 ¦ SOLUTIONS IIVE STEPI RT 


ж up dp UP oup че «ғ «ғ чо ею чю чр чо чо XD чо чо чо AD өш «ғ «ғ «о «ғ «Ы «ғ «Ы «ғ up up P UD P DP DP чо DP чр up P oup Up P чр P OP чр P oup UD XP UP ЧР чє XD UD "p чр чр CLR чш чо чо XD чо чо чь чо чь чь D чь чь чь чо чь "D "D Up 4B чь Um 


! 

4 ‘Define Data Structures 
'a) Use Freelist (M1) of 451 
i4 byte woras used to provide 
information about successors 
‘of parent nodes (each of max. 
'30 parent nodes may have up to 
‚14 successors) 
¡b) Use Freelist (M2) of 20001 
IA byte ¡items to keep inforna- 
'about original nodes, oath 
¡headers anda cossible pat^s 
(through the directed graoh 
¡being analyzed. 
ı (each item is desiconed to hola; 
14 integer values oetween 0 ana; 
855955) 


3205 
1600 


un 


3/05) 


سسا 

о 
„ч 
e 


see also 
remarks 

on cade 1 
2/05 
1630 


! 

S ı4Desian of orimitives and 
iutilities to sucoort data 
‘structures 
ға) Primitives for Freelist 1: 

“Initialize Freelist 1 

“Carl, Cdri (retrieval of 

integer values) 

“Setcari, Setcdri (set values) 

“Allocatel, Freel (allocate/ 

free elements of M1) 


ы соч 
on 
in © 
o wl 


b) Primitives for Freelist 2: 

“Initialize Freeliser 2 

“Care, Care (retrieval of 
integer values) 

-Setcard, Setcare (set values) 

-Allocate2, Free2 (allocate/ 

¡free elements of M2) 


— ім 
IN М. 
in O 
оо 


— iN 
Ut x 
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== eer wo os os os ss 22 secs DD DD DO DA DD DU Da a ga za ge wee za ewe ma oa so Jo co zo oo om zo za ҸӘ e PAE DD 
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АММЕХ А 


NORKSHEET FOR DESIGN PHASE ANO DESIGN REVIEN 


SIEP 


5 


8 


PROBLEM AND PLANNED SOLUTION 


' 

‘Define Algorithms for Utili- 
¡ties to support structures 
fusing M1: 

‚Мате, Setname 

“Brother, Adoprother 


“Son(i) (get mame of ith son) 


‘Define Algorithms for Utili» 
¡ties to suoport structures 
fusina M2: 
¡a)Supoort of 
‘oath headers: 
“Set Path ID, -Path IO 
“Linkpath(forwara/tackward) 
“Initialize Pathlist 

-Next path, -Prevyious Path 


linked list of 


15) Supoort of oath structures: 


(retrieve noce name) 
-Predecessor 

-Successor 

“Number of Successors 
“Linking of modes( forward ang 


¡“Name of 
! 
| 
! 
% 
' 
| 
,' 
i backward) 
i 
4 
! 
1 


-Duoglicate(set duplicate node) 


-Addnode 
“Duplicate a Path 


¡“Implementation of altermative 


oath 
4 

1 
Define Procedural 
-Remove a Patn 
“List Path 
“List all 


Alaorithms: 


! 

' 

b 

1 

! Paths 
("Find End of a Path 
"Fina Original 
' 

' 

0 

è 

J 


Фе сәер se ww owe o o mm 


ALTERNATE 
SOLUTIONS 
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Раде 4 


РНАЗЕ 


OF PROJECT 4 


of 


¡DAY 


5 


МАМ 
¡ HOURS ¡ERROR 
5 


'TIME!/STEP! 


æ (N 
an 


о о 


оо 


13/07) 


c 
eo 
eo 
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analysis 
‚айта not 
include 
¡trivial 
¡case 





АММЕХ А 


WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEW PHASE 


STEP 


9 


A 


' 
PROBLEM AND PLANNED SOLUTION ! 
' 


;Desian Review: 

¡Define global cointers: 

|i 7-Pathhead 

;*Currentpath 

i"Lastpath 

| "Currentnode 

‚«Lastoccurence 

'Define algorithm for path 
‚analysis: 

ı=Set Paths 

iScecify logical algorithms: 
-Occurs Twice (node with same 
ıname on same path) 

¡“One Nay (loop without alter- 
¡native branches) 

¿“Match (same sequence of nodes 
¡duplicated on current path) 
¡=Checkback (check for invalid 
ialternatives) 


ea ow on vo fe bo P m o - - o o a. za ouo >=. "o mm» woe oe 


ALTERNATE 


SOLUTIONS 


111 


Page 


SILOS 


MAN 


OF PROJECT `Z 


' ' 
% ' 
'DAY !HOURSI!ERROR! COMMENT 
'TIMEI/STEP! ! 


e A 
EN 


о о 
о 0 
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АММЕХ С Page 1 of 2 


NORKSHEET FOR CODING PHASE OF PROJECT A : 2 
Beginning of Coding (day/time) : 3/06/1500 
End of Coding (day/time) : 3/10/1730 


Man hours : 26 (ineluding punching of cards) 


1) 
CODING |... PROGRAM PART HERROR!DAY | COMMENT 
BEGIN i END ' 2 TIME: 
EXNXTIME ! OAY/TIME ! ' i ' 
' 11) Record when error is 
' i detected. 
03/06/1500 -Data Definition 13/00! 


a 
2 15402383 
> ,18205C23 


-Primitives 
-Error handling 
“Initialization 


03/00/1630 ' 
03/06/1630 “Punching cards : 


( 4 ( 
4 ' ' 
' ' : 
( ! y 
! 1 ! 
i i : 
' ' ' 
' i ' 
i ' ! 
; , Ä 
' ' ı а 11740(С28 
'03/06/1800! ' ' 
03/06/1830! ¡“Utilities ' ' i 
103/06/2030! ' ' 
05/07/1200! "Utilities ‚37/07, 
í (| 5 1305:09 
' 03/07/1400! 
03/08/1000; i-Punching cards | "37/08! 
' ı (Utilities) 10 ;1000:C1le (missing BEGIN) 
' ' peli, 100s C28 (mispelling of 
' ' ' ' ' procedure name) 
i СЕЛТ 0005.623 
' ' 13.2710 102616 
' ı 14 (ites ve! 
i i ІЗ! ОО, ЕЕ? 
' i O осоне 
¡03/08/1200 ' i ' 
03/08/1530! ¡"Coding of pro- | ! : 
' ı cedural suorou=-; 18 311630109 (design did not 
' ı tines ' ' |! Consider removal of 
103/08/18001| ' ' ı first and last oath) 
03/08/1900! -Coding of oro- | ' i 
: |! cedural subrou-! ' ' 
103/08/2000! tines i ' ' 
03/09/2000! =Punching cards | ' ' 
1 ' (Uv 21901011 (faulty design 
' ' ' ' ' ОЕ index calculation) 
! ' ı 20 ¡2150;¡C10 (faulty condition 
' ' ' ' "Not Equal” instead of "=" 
03/08/2200! I ' ' 


= i 





АММЕХ С Page 2 of ? 


WORKSHEET FOR CODING PHASE OF PROJECT g : 2 
Beginning of Coding (day/time) : 3/06/1500 
End of Coding (day/time) 2 5710/1730 


Man hours : 26 (including punching of cards) 


03/10/1730 


15) 
CODING 4 РВООКАМ РАВТ 'ERROR!IDAY | COMMENT 

BEGIN ' END ' о в ГІМЕ! 
DAY/TIME | DAY/TIME | ' ' ' 

' ' ' ' 11) Record when error 

' ' ' ' ' detected. 
03/09/1200! «Coding of 1/0 | 13/091 

i ı subroutines ' ' 

!03/09/1300! : ' ' 
03/09/1300] | "Punching caros i | 1 

' ' {¦ 34 {]а40{С11 

103/09/1500] ' ' ' 
03/09/1500! ¡"Coding of Logi-; ' ' 

' ı cal orocedures | 35 11530109 

i ' 58 i 1515;09 

103/09/1730! ' ' i 
03/09/2000! i“Puyunchima caros | I 1 

ЧО 1209 3006210 

103/09/21001 
03/09/2100! ("Coding of path | ' ' 

' |! analyzing algo-i1 42 12200109 

' ' ejithm( "Set ' ' ' 

!03⁄/09/23001 oatns") ' ' ' 

' % y Ü ' 
03/10/1000] | "Punching caras | 310% 

; ‚бода 100015 

05/10/1100! ' ' ' 
03/10/1100; I=Coding of 170 } 

ı Subroutines ' ' ' 

03/10/1200! 
03/10/1630, ı=Punching cards | | | 

i ' ! 46 1700, 09 

' 1 ' ! 1 

| | TEE 


Ms 





ANNEX D 


PROJECT 2 < 
Begin of Deb 
End of Debug 
3 of Debug S 
F time for 
a) 0.89 
Man hours fo 


STEP! PROGRAM 
а ! PART 


1 ¡Primi- 
‘tives 
land 
рагі о? 
lutilie- 
у тез 


Pu 


3 lPrimi- 
‘tives 


o mo ma AA eo o b m» b db bu bp D bb pu Ab b o 


WORKSHEET FOR DEBUGGING PHASE 


e DEBUG Run 8 


і 


ug Run (day/time) : 03/06/1800 


Run  (day/time) : 03/07/1400 


teps incl. in Debug Run: 
necessary compiles (sec) 


b) 1.76 С) 1:68 с) 


4 


Расе 1 о! 


Id 


CPU time for Debug run (sec): 1.82 


f 8.33 


e) 


f ) 


а) 


r this Debug Run : 4,0 (including preparatiom of debug run) 


OBJECTIVE AND EXPECTED 
RESULT 


Get error free coroile 


Repeat step 1 


Check initialization» 
allocation and freeing of 
items in both freelists. 
Check carameter implemen- 
t 

Е 

15 


¡(pointers of freelists 


¡must be set appropriately, 
‘allocated elements must be 


¿filled with zeroes, 
allocated items must be 
unlinked,» 

rafter freeing an element 
¡becomes part of the free- 
‚list again, 

‘Parameters should be set 
¡as designed) 

¡repeat steos 1 апа 3 


ACTUAL 
RESULT 


3 comoile 
errors 


O 
. 
X 
. 


‚uooer 


ге! 


iof M2 mot 


ifi 


iwi 


thalf of 
‘allocated 


ement 


lled 
th 


! zeroes 


114 


МАМ 


b) 


DAY ¡ HOURS; iS COMMENTS 


y TIMES/STEP¡ 


1250 


ma — чь wu bou DA a om A m b AA DP DP P om Da ua «о dp ж. «к. а» жж а аз aa aa a a ma 


EN 
о о 
on 


= = ma өзі ы ыж «о» bo om m m am X co zn we b UP an au mo zo ma Sn De ae an vu ma gan mn sa oe we 


чо 


ANO CODED 

E TYPES 

1) Record when 
error 
OCCURS 


БАЛ СЫ” 
¡left out 
¡while pune 
iching cards 





ANNEX D Page 2 ої 11 


NORKSHEET FOR DEBUGGING PHASE 
PROJECT # : 2 DEBUG Rum 8% 2 2 
Begin of Debug Run (day/time) : 03/08/1000 
End of Debug Run (day/time) © 03/08/1700 
# of Debug Steps incl. in Debua Run: 2 CPU time for Debug run (sec): .46 


CPU time for necessary compiles (sec) : 2.23 


sling 5. 
i ! 


а) 2.23 b) с) с) e) f) g) 
Man hours for this Debug Run : 2.5 (including oreoaration of debug run) 
MAN 1) 
STEPIPROGRAM; OBJECTIVE AND EXPECTED $ ACTUAL ! DAY!HOURS!ERSOR! COMMENTS 
u. PART | RESULT i RESULT !TIME!'!/STEP! 1 Rib CODED 
' ' i ' ' ! ERROR TYPES 
' : J н i ' 11) Record «nen 
' ' ` ` i ' ' error 
' ' J ' : ' : occurs 
1 IPrimi=- iCheck maximum number of ; 37293, ' f 
‘tives allocations in both free- | 1000 i ! 2ë man hours 
"апа Ее. i | po ıspent in 
саге ої! (211 elements exceot free-; OS ' ' ' ¡preparation 
tutili- [list headers are alloca= | ' i ' fof deoug 
¡ties ¡ted) ' ' ' ' ırun 
H ' ' ' ' ' J 
2 ¡Error {Check error messages for | н ' ' ; 
!hand-  iexhaustion of each free- | 23/708, 0.2 ! i 
BE 700° I н 
' 0 0 ! 


= 115 = 





АММЕХ 0 


HORKSHEET FOR DEBUGGING 


PROJECT # : 2 
Begin of Debug Run (day/time) : 


End of Debug Run (day/time) : 


Page 3 of 11 


PHASE 


DEBUG Run & : 3 
03/08/2200 


03/09/1300 


4 of Debug Steps incl. in Debug Run: 7 CPU time for Debug run (sec): .6 
CPU time for necessary compiles (sec) : 18.12 
а) 2.657 D) 2.75 CONES а) 2,45 e) 3.49 f) 84.05 g) 
Man hours for this Decug Run : 4.5 (including preoaration of Jebua run) 
MAN 1) 
STEP{PROGRAM! OBJECTIVE AND EXPECTED | ACTUAL ! DAYIHOURSIERRORI! COMMENTS 
4 ! PART 3 RESULT ı RESULT {TIME!/STEP$ = ¢} ANO CODED 
1 : ' ‘ ' ' EPROR TYPES 
i ' ' t J i 11) Record wħen 
' ' ' ' i i ' error 
J 1 j ' ' ' À occurs 
1 ¡Primi- ¡Get error free comoile of | 75 com- 153/08! ; i 
ıtives, iall subroutines and pri- ipile diə- 2200; 1.0 | ' 
¡Error imitives excludina I/O suo-ianostics | ' н ' 
ıhand* iroutines and logical sub- ¡(see '2209| CEI IEE 
iling: routines. ¦ remarks); s fecu ly 
‚ Ргосе- | cese 
‘dural | ' ' i ¦ 24 [А] 
isuoOrou-i| ' ! ' н ' 
Itines } ' ' ' i ' 
' ; ' і : ' 
zog 'РесезЕе steo | ‚eeds, 20,59, 2 ped? 
' % ! q 1 ! 
L] 4 è 4 ' è ! 
B i Repeat step | : 23100, 0,5 1 26 188 
1 ' è 4 i 4 1 
% è 0 ' ' ' ' 
4 ¡Repeat step 1 сзсз ое, BET CE 
! 4 ! ! ! 1 ! 
! 1 1 1 ! 1 ' 
S" e ¡Repeat steo 1 J D09! 10 FF DAN] 
I ; 10350! e e AT 
' i i ‘ ' ТӘЙ | 
' I : ' ' La Ss lope Ad 
' i J ' / зам, А | 
; J ' ' ' Ш 33 027 
' ' ' ' ! ! ' 
6 |) ¡Repeat steo | } В.К. 151918503 7705551 ' 
1 ' è ! ' ' ' 
0 ' 4 4 ' ' ' 
BH i ‚Reveat debug runs 1 апа 2 | ООК ISO, 1,27! i 
' ‚(заме results exoected) i 13/091 ' ' 
i | i ' ' i ' 
Remarks: 


The ALGOL comoiler diagnostics do mot always 


investiaation of all errors. 


allow a complete 


O 





АММЕХ 0 


Раде 4 of 11 


WORKSHEET FOR DEBUGGING PHASE 


PROJECT 8 : 2 
Begin of Debug Run (day/time) 


End of Debug Run (day/time) 


DEBUG Run # 3: 4 
> 03/09/1500 


2 03/10/1200 


# of Debug Steps incl. in Debug Run! 6 CPU time for Debug run (sec): .61 
CPU time for necessary compiles (sec) : 235.45 
ay 3.67 ӘЛ 95.02 ел 3.20 а) 4,60 е) 4,96 ғ) а) 
Man hours for this Debug Run : 3,0 (including creoaration of decug run) 
MAN 1) 
STEP{PROGRAM; OBJECTIVE AND EXPECTED | ACTUAL |! DAY? HOURS:ERROR{ COMMENTS 
a ! PART ! RESULT ЕО TIMESTEP! 727 + ANC CODED 
! ' , : ' €RROR TYPES 
' ' ' ' ' i Il) Record when 
' ' i Г еггог 
m 211 !Get error free comoile. {2 comoile;: 3/093 ' ' occurs 
'subrou”! ¡errors SOO OCS : 
itines ¢ i ' ' ' ' 
except i| ' (1750! EN Sue 
logical; ' ' ' ¦ 38 TAI 
iproce- | ' ' ' ' ' 
ıdures | I ' н ' ' 
2 | ¡Repeat step 1 i D. A ' ! 
БЕ 11/0 (Check input for trivial ınumber of}1950: 0.5 | ' 
' ‚cases Succes» 12000) | 39 ¡C26 (READ and 
' ' Sors plae! ; ' READON con- 
' ' iced in ' ' ! i fused) 
! н ¡wrong ' ' ' н 
' ' field ' ' ' ' 
Б, 'Repeat steo 3 with trace | peteso 4 ' 
' 'and preceding initializa= | i ‘ ! : 
' Ition of freelists as well | і ' ' ' 
' газ initialization of list |} ' ' : ' 
' ¡Of path headers. i"wrong ма= ! 2200; болар TA] 
! ‘Check function "SON" for ‘tue rpe» | н ' ' 
I ¡Correct return values ¡turned ' І ' ! 
1 i (trace should match «1th from "Numi Р ! ! 
: ¡design considerations) ¡ber of ' н ' І 
н ' Succese i ' ' : 
' ' sors" ' ' ' н 
Sa |! ¡Repeat step 4 "Missing 12520! 0.5 ! 
} ' Link 123901 Іі 405 169 
6 1| ¡Repeat step 4 ' 125501 0;,5 ' 
' ' H DONT 4 н ! ' 
i ' ' (57101 i ' 
' ' ' 100, ' ! 
Remarks: Functions and subroutines are first checked for trivial 


cases and Doundary conditions. 


ІРІ 
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WORKSHEET FOR DEBUGGING PHASE 


PROJECT 2 : 2 DEBUG Run 3 ? 5 


Begin of Debug Run (day/time) : 03/10/1600 


End of Debug Run (day/time) : 03/10/2400 


4 of Debug Steps incl. in Debug Run: 5 CPU time for Debug run (sec): 1.55 
CPU time for necessary compiles (sec) : 29.49 
ӘН 5.71 о) 5.94 С) 5.43 09023579 е) 6.62 f) g) 
Man hours for this Debua Run 5.0 (including preparation of debug run) 
MAN 1) 
STEP!PROGRAM! OBJECTIVE AND EXPECTED ! ACTUAL | DAYIHOURS/ERROR! COMMENTS 
© | PART | 2ESULT ЕЕ IES ME 3 (AD ODED 
' ' ' ' ' ' ERROR TYPES 
' ' ' ' ' i 11) Record when 
' ! i ' i ' ' enron 
1 3411 Check for trivial inputs | 13/10; i i Occurs 
‚Primi- ifor all primitives anc ¡error (ІЗІ. 0.5, 
‘tives Jutilities. in linke | | ' i 
and 1 ring 1600! ASA Cel 
Utili- } ' ' 
¡ties - ' ' ' н ' 
' ' ' ' i ! 
2 ¡Repeat steo | e oO O SOS 
è ' ! [| ' ' ' 
èb è è ! ' ' è 
a = ıRepeat steo | ‚5 ргоагат,1950, 24.40 | t 
' ' 'еггог$ 1930. > 48 ¡C21 (state- 
' ' i found iments in re- 
; ' н ' ' ' ‘verse order) 
' ' ' 21001 1 49 ¡012 (wrong 
' ' ' ' ' istopping 
' ' | ' ' ' condition) 
' ' ' (21501 С 50 CB (faulty 
' ' ' ' ; ' (initialization 
2 - iof loop) 
' ' ' ' ' ' н 
go) ¡Repeat step 1 2 ргодгат! 2200! 1.0 ! 
` ' ‚errors ‚2250; 1251 184 (error 
' ' ' i ' ' ıin correct- 
н ' ' ' ' ' (359) 
' ' н 10300! ¦ “SAC 
i ' ' ' ' ' ' 
Bo ‚Repeat step 1 OK E 1010.5 
i ' 12550; ' н 
Remarks: Procedures checked for trivial cases and boundary conditions. 


IMS 
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WORKSHEET FOR DEBUGGING PHASE 
PROJECT # : 2 DEBUG Run # : 6 
Begin of Debug Run (oay/time) : 03/10/2230 
End of Debug Run (day/time) : 03/11/1700 
2 of Debug Steos incl. in Debug Run: 5 CPU time for Debug run (sec): 2.14 
CPU time for necessary compiles (sec) : 26.3 
a) 5.14 b) 6.62 СЛ 7239 9) 7715 e) f) 9) 


Man hours for this Debug "un : 6.0 (including preoaratıon of debua run) 
МАМ 1) 
STEP!PROGRAM! OBJECTIVE AND EXPECTED 1| ACTUAL {| DAYS HOURS!SERROR! COMMENTS 
8 ! PART |! RESULT | RESULT ITIMEI/STEP! 2 ! AND CODED 
' ' ; ' i ! EPROR TYPES 


è 
' ; 1) Record when 
I ' 


' ' ; н ' ' error 
1 pal) ¡Get error free comoile of ¡8 comoile;3/10; 1.0 ' occurs 
; ‚all orogram parts. ¡errors ‚2300: ' ' 
' ' ' 2510! | 
' ' ' ' ' SAAT 
' ' ' н ' 1205 5 IAM 
' ' ' ; ' ета! 
' ' ' ' ' (S RS AM 
' ' ' ' н 1 728 7228 
н ' ' ' ' Pee Do ie S, 
' ' ' ' ' 56505769 
' ' ' ' ' ' ' 
сЕ: ¡Reoeat step 1 | Шақа 12350: 0.5 ' 
' ' ' 13/10! ' 
н ' 2400} ' ' 
' ' ' ' ' ' : 
2 іосіса! |Сһесе for trivial cases ; SNN SEO | I 
Iproce- iwhile analyzing one oath. il error 11400! ' ' 
(dures ¡Check writing of a path. ı found ‚1900, el] Cel (reset 
land (al? functions shoula oere»; ' ' ' (forgotten) 
fwritina! form as desianed) i ' ' ' ' 
‚of a ' ' i ' ' ' 
‘oath ' ' ' ' | 
' ' " , ' 1 ! 
44 ¡Repeat steo 3 12 errors $1545; 1.0 } 
' н ¦ found 1620) ¦ 62 {C10 (wrong 
' > ' ; ' iStopDing con- 
' н : н ' ' idition) 
н ' ' 11630! EET CD 
' 0 ! b i % ' 
' ' ' ! 4 ' ' 
© | ¡Pepeat steo 3 216301 0.5 | 
н ' DK SZ le ' ' 
н ' ' "12003 ' i 


- 119 - 
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WORKSHEET FOR DEBUGGING PHASE 
PROJECT 4 : 2 DEBUG Run # 3: 7 
Begin of Debug Run (day/time) : 03/11/1700 
End of Debug Run (day/time) : 03/12/1600 
# of Debug Steps incl. in Debug Run: 5 CPU time for Debug run (see): 2.61 
CPU time for necessary comoiles (sec) : 38.78 
а) 8.05 Б 7.91 c)” 7.58 GUT Se е) 7,22 n g) 


Man hours for this Debua Run : 7,0 (including preparation of detug run) 
MAN 1) 
STEPIPROGRAM! OBJECTIVE AND EXPECTED | ACTUAL 1 DAY IRHOURSIEPRORI COMMENTS 
a o! PART | RESULT i RESULT (ТІРЕ! /5СТЕР” 2 ı AND CODED 
' ' ' І ' I ERROR TYPES 


11) Record when 


! ! ! ' 
' ' ' ' ' error 
1 !Proce- Check analysis of oathes. ¦2 ргозгат! 3/11! 0.5 ' occurs 
! dure "(А11 oathes are implemen=- ¡errors ‚11001 ! А 
Set ited indoubly linked lists) . 1730; ' Ба (012 (wrong 
üpaths" | ' ' ' ' iStoocoing con- 
' ' ' i ' ' 'атетоя ) 
' ' ' 117451 Іі 65 IDII (wrong 
' ' ' ' i ' ıindexing) 
' ' ' ' ' 4 ! 
, ' ! ! ! 4 ! 
zm |! ‚Reveat steo | Рог 115805!) 0:5! ! 
' ' ı found 11810! 661011 (зате as 
' ' ' ' ' ‚error 55) 
, ' ' ' 4 ' ' 
Ц Ц ! ! ' ' ' 
B 4 iReceat Steo | с еггог |1820; 525 1 ' 
' e ı found н ' 
н ! i 15402! ' ' 
' ' ! „1300 ¦ 67 103 (forgotten 
' ! ' ENS, ' 66 '03 update 
' i ' ‚1320, ı 69 ¡03 of a vari- 
' ' ' І ' ' ' able) 
' ' 1525) йі 129 
' : 113401 ı 71 184 (misinter- 
i н i н i ' ıpretation of 
н ' ' ' ' ' 'error source) 
! ' ' ' ' н ' 
ШІ! ‚Repeat stepo 1 il error 11800, 1.5 | 728 109 
' ' i founa ' ' н ' 
' ' : н ' i ' 
5 | Repeat step | О.К. $1530! 0.5 ! 
i ' ' 12/12! H ' 
' ' ' ‚1600! ' ' 


- далу - 
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WORKSHEET FOR DEBUGGING PHASE 
РШОСЕСТ 2: 2 DEBUG Run # ; а 
Begin of Debug Run (day/time) : 03/13/1600 
End of Debug Run (day/time) : 03/14/1600 


# of Debug Steps incl. in Debug Runs 3 CPU time for Debug run (sec): 162.75 


CPU time for necessary compiles (sec) : 19.59 


a) 6.63 b) 6.45 AO ol о) е) f) а) 
Man hours for this Debug Чип : 17.0 (including oreparation of cebuqg run) 
MAN 19) 
STEPIPROGRAMI OBJECTIVE AND EXPECTED ! ACTUAL ! DAY!HOURS!ERROR! COMMENTS 
4 PART ! RESULT | RESULT ТТІРМЕ!/5ТЕР! - t ANO COOEO 
' ' i ' ' ' ERROR TYPES 
' ' | | ! ' 11) Record when 
' : : ' ; ' ' error 
; ' ' | i ' occurs 
1 ШАТ | !Check various small direc-!1 error 13/13) i ' 
' 'ted araphs for boundary i foung 1500: 3.0 I 
: Neonat 1 Ons. fin "Mate | i ' ! 
i ' 'ching" 20080, ' 73 1C29 (wrong 
' ' i i : ' ıbranching) 
j : i i i i ' 
e |! ¡Repeat steo | l error БИЧ 16.0 |} I 
À | ¦ found 10700! ' i 
i ı (some 1100! КӨЛІ DOI 
' ; iDaths i ' ' i 
' i iSkioped | ' i i 
' t ¡during : i ' i 
' ' analysis); i ' ' 
' ' ' i ' ' ' 
B 'Reoeat steo 1 I и TOT ' 
' ' i "2/14! ' ' 
' ' | ' 1600} | 


Remarks: Error analysis during this deoug run was extremely 
difficult and time consuming for the following reasons: 
= Most results were verified Dy desk checking. 

- The imolementation of oaths was checked Dy 
examining the contents of allocated items of 
both freelists (M1,M2). 

= Some structures being tested had a very large 
number of oaths ( > 2000). 

= The orogram contains a great number of rather complex 
algorithms, each of which had to be tested with 
resoect to its boundary conditions. 


=I l 
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NORKSHEET FOR DEBUGGING PHASE 
PROJECT 4 : e DEBUG Run 3 : 9 
Begin of Debug Run (day/time) : 03/13/1100 
End of Debug Run (day/time) : 03/15/2300 
# of Debug Steps incl. in Debug Run: 1 CPU time for Deaua run (sec): 3.92 
CPU time for necessary compiles (sec) : 7.52 
- 7.52 b) С) с) е) 3 9) 


Man hours for this Debug Run : 3.0 (including preparation of deoug run) 
MAN L5 


STEP!PROGRAM! OBJECTIVE AND ЕХЕЕЕТЕО. , ACTUAL {| CAYTHOURS | ERROR; COMMENTS 
# 1! PART | i RESULT RESULT TIMESTEP SFT AO CODED 
' ' н i ! ERROR TYPES 
' ' ' ' ' ' 1) Record when 
і j ' i ' ! ' error 
' ' ' f ' ! і Occurs 
А] | ICheck internal error i 3713, 5.0) ' 
' i"nessages. н 1253045: ' ' 
' i (Error messages 5,о,7, i Век. | i ' ! 
! 11,12,15 shcula be prine | ' i i ' 
' ited) À 132415! ! ' 
| ' i 12300; ' ' 


f u= 
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ШЕШЕСІ 4: 


Page 10 of 11 


WORKSHEET FOR DEBUGGING PHASE 


2 DEBUG Run 8 


: 10 


Begin of Debug Run (day/time) : 03/16/1500 


End of Debug Run (day/time) : 03/16/1600 


# of Debug Steps incl. іп Debug Run: 


CPU time for necessary comoiles (sec) 


a) 


573 


о) с) а) 


1 


CPU time’ for Debug run (see): 6.75 


mS hours for this Debug "un : 1.0 (including preparation of debua run) 


> on oo vo vo vo oo ao vo 


PART 


' RESULT 
! 


‚error messages. 
' (еггог messages 10 апа 8 
ishcula be or!intea) 


OBJECTIVE "AMD EXPECTED 


res 


75755 
e) f) а) 
МАМ 1) 
ACTUAL i OAYI*QURSIEPROR! COMMENTS 
RESULT !TIME!/STEP! з САП CODED 
I I ! ERROR TYPES 
н J ' '1) Record when 
' ' ' ' error 
H : | ' occurs 
ККИ Мө, ПО! ; 
1500. i ' 
[QE | : : i 
: ' ' j 
13/106! i ; 
110005 i i 
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WORKSHEET FOR DEBUGGING PHASE 
PROJECT 4 : e DEBUG Run 58 : 11 
Begin of Debug Run (day/time) : 03/16/1600 
End of Debug Run (day/time) : 03/17/1200 
A of Debug Steps incl. in Debug Run: 2 CPU time for Debug run (sec): 6.45 


CPU time for necessary compiles (sec) : 14,95 


ғ 


а) 7.90 БЖ. (7705 e а) e) f) о) 
Man hours for this Debug Run : 2.0 (including preoaration of ceoug run) 
MAN 1) 
STEP{PROGRAM} OBJECTIVE AND EXPECTED | ACTUAL DAY (ROURSI ERROR! COMMENTS 
z ' PART RESULT UNERESUCTTTTIME!/STEP! IC AT DOEDDE C) 
' ' i ' i ' ERROR TYPES 
i ! I i ' ! 11) Record „nen 
' ' | ' | ! error 
' ' i ' i ' i occurs 
1 Al] (Check error message 3 9, ¡error SAN EO, i 
' ' ımessaae 119500; ' i 
' ' 's 9 not 11800! (x5 nce] 
н ' iprinted | i i ' 
2 ‹ ¡Repeat step 1 i ИО: t 
i ' : К: 321850! i 
i І ' 55717! ' ' 
i i i 1120071 ' À 


- 124 - 





ANNEX Ei Pace 1 of 3 
ERROR LISTING 
PROJECT £ : 2 
Begin of Project (day/time) : 03/01/1900 
End of Project (day/time) : 03/17/2200 
Mam hours for total project : 125.0 
ERROR; PHASE {| PHASE | ERROR ' TIME | 3 of OTHER 
8 14 in which! in which; TYPE spent to i| STATEMENTS OR 
IERROR «asi ERROR wasi (see ANNEX F) ‘solve the; PARTS OF THE 
: dis- | made | ¦ ERROR t PROGRAM 
|! covered | i ı (Man J AFFECTED 
' ' ' : Mineo |! 
Coding | Coding i C28 ' 5 ' 
65091 ла ; Coding : C28 5 ' 
Ku Coding ; Coding |: C23 ' 2 ' 
4 ¦ Coding | Coding ! C28 i 1 ! 
S Debugginqi Coding i: Atl í S ' 
6 iDebuggingi Coding | C23 ' 5 ' 
7 iDebugginai Coding i Al i 5 ' 
8 :Denugaing: Coding i Al 10 ' 
9 1 Coding i| Design 1 09 55 | ^hole algorithm affected. 
оспа i: Coding : Cle ' 1 ' 
Coding ! Coding | C28 i 1 | 
K Coding i Coding | C23 i 1 ' 
ШИ! Собіпс : Coding ! С16 ' 1 ) 
ШЕ! Сөбіпе | Coding i Ct i 5 
cocina | Coding i: Ci? ' 2 ' 
ШІ) coding i: Coding ; C17 : e A 
17 ¡ Desian ı Design 1 09 1 ' 
mom Coding ; Design 1 09 ' 30 ‚ Whole algorithm affected. 
Hoe coding | Design ! 011 i 5 ' 
ШЕ Содіго | Coding ! C10 i 5 
21 }Debugging: Coding ı C23 5 
22 !Debuagingi Coding ! С17 153 ' 
23 Debugging! Coding i C27 : 5 I 
24 Debugging! Coding | Al ' 2 ' 
25 Debugging! Coding 1) С17 i 5 i 
26 iDeougaingi Coding : Ae ' 10 ' 
27 Debugging! Coding i C28 ' 10 i 
28 Debugging! Coding | C17 ' 5 
29 iDebuggingi Coding ! СІП H S ' 
30 {Debugging: Coding ! А1 ; 15 i 


125 





ANNEX El 


ERROR LISTING 
PROJECT 4 : 2 


Begin of Project (day/time) : 03/01/1900 


End of Project (day/time) : 03/17/2200 
Man hours for total project : 125.0 
ERROR | PHASE i PHASE ' ERROR 
# | in which, in which, TYPE 
' ЕРАОК wası ERROR wası (see ANNEX F) 
! 215“ i| "ade | 
! Covered i| ' 
H ' ' 
31 ıDebuaging: Coding ! А] 
38 iDebugging:i Coding : 41 
BExDebugging: Coding | C27 
ШІ Состіпа 1 Codina | C11 
p Coding i: Design ¦ 09 
Bom coding . Design 1 09 
An Debugging!) Coding ; C23 
38 ¡Debuggingi Coding ! A1 
В: бБебсса по! Coding ı C26 
40 ¡Debuggqina: Coding : C20 
41 Debugging: Coding i Ål 
42 í Coding i Design ! 09 
43 iDecuggingi Design ! 09 
44 | Coding , Design ! 015 
45 Debugging! Coding $| C27 
46 | Coding | Design ¦ 09 
47 ıDebusgingı Desian ! 09 
48 ¡Debugaing! Coding ) С21 
49 ¡Debugaing! Design ! 012 
En Debugging: Coding ! C8 
51 :Debugaing: Debugaing,; 84 
52 :Debugaing, Coding | C23 
53 ¡Debugginai Coding ! Al 
54 ¡Debugginaí Coding i Al 
55 ¡Debugging; Coding | ål 
56 Debugging! Coding |: Al 
57 Debugging! Coding ! А1 
58 ¡Debugaing; Coding . C28 
59 ¡Debugging; Coding | C9 
60 Debugging! Coding | C9 
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TIME | 
soent to | 
solve the; 

ERROR i 
(Man ' 
mune)! 


E 
e 
5 
1 
15 
15 
5 
5 
30 
D 
5 
20 
10 
S 
10 
5 
60 


>> po 
Uu un o 


fu 
oO 


ee gm oo vo zo So pm a zz zo oa za per nm mm Da Deu zn ma ma dm Da DE A DA a =з єз Da eo ow 


Un un ul n) n) n) y Un Lun 


of 3 


я оЁ OTHER 
STATEMENTS OR 
PARTS OF THE 

PROGRAM 

АРЕЕСТЕВ 


Whole algorit^m affected. 
Ahole algorithm affected, 


Whole aigorithm affected. 


Nhole subroutine affected. 
(3 changes necessary) 





ANNEX ЕІ 


PROJECT я : 2 


Begin of Project 


ERROR 
3 


End of Project (day/time) 
Man hours for total project 
ШІ РПАВЕ | PHASE | 
| in which! in which: 
(ERROR was; ERROR «as; 
J gaise | "ade | 
|! Covered | ' 
' ' ' 
i:Debuaaingi Coding i 
iDebuga3ing! Coding | 
iDebuggingi Coding | 
ıDebugging:ı Design à 
¡Debugagina; Design i 
Debugging: Design | 
i:Oebugaingi Design | 
‘Debugging: Desian | 
Debugging: Design | 
‘Debugging: Coding | 
:Debugging: Debugging; 
ıDebugging; Design , 
Debugaing! Coding |! 
ıDebuggingı Desian | 
Debugging: Coding | 


(day/time) 


ERROR LISTING 


03/01/1900 


03/17/2200 


125.0 


ERPOR 
ТҮРЕ 


(see AMNEX F) 


C27 
C10 
C29 
012 
011 
Di 


ко 


' 
1 
! 
4 
' 


— 
> 
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TIME ' 
spent to ; 
‘solve the; 

ERROR | 
; 
' 


5 
p 


of 3 


8 of OTHER 
TATEMENTS CR 
ARTS OF THE 

PROGRAM 
ar ee nee 





АММЕХ Е2 Page 1 of 3 
ERROR LISTING (COMMENTS) 
ERROR! DAY ! COMMENTS 
Ё t TIME! (EVIDENCE, THOUGHTS, WHY WAS THE ERROR MADE? 
: | WHY AND HOW NAS THE ERROR DISCOVERED? 
' ! ERROR BLOCKING, etc.) 
103/06; 


€ in гу 


rw 


e~ Фе 29 mo so So za Sa aan Da zn pm zo Ta zo Fr ro ze zz pr ze pn ma Sa aa ge > @e Чч = ma oe =» әсе» «ы» «> аа» ж ne we чәчә >=. Ro чь 


1530 Еггогв !,2,3 were discovered while reading previously 
(written sections of code. 

1540! 

1620; 

t74O0iLack of concentration while punching cards. 
i (Main disadvantage while sunching cards is that cunchea 
¡data is not immediately seen after each key stroke.) 

1815! зате as 4 

1815,Programmer did not check programming manual. 
¡have been avoided) 

1815: same as 4 


(error could 


03/07: 


1505; 
1305: 


03/08; 


1000: Еггог$ 10-17 were detected because orogrammer punched caros 
i himself. it is quite natural that ^e uses this time to review 
(his 6о2е. 

1005! 

1005! 

1010! 

10251 

1030! 

1030; 

1505! 

16530: Еггог found during desk test. 

2130 Error found while punching caras. 


21501 1same as 19 

2200! 

ea200iFunction name used as local variable. 
2200! 

2200! 


2245, Incomplete correction of error 4 22. 
2310}Mandatory declaration omitted while punching Cards. 
2323, Right parentesis omittea.. 


03/09; 


L030iLack of concentration while punching cards, 
ı (Programmer was tired.) 

1030; зате аз 28 

1030! зате as 28 

1030: зате as 28 

1050: ѕате аз 28 


1285 





Раде 2 оф 3 


(EVIDENCE, THOUGHTS, AHY WAS THE ERROR MADE? 
WHY AND HOW WAS THE ERROR DISCOVERED? 


2030}Usinga а local variable nare from different subroutine. 


1700,Thinking of boundarv conditions while puncning cards. 
1730:Desk test was not made carefully enough. (one case 


2130: Еггог was discovered Curing Structured Yalx Through, 


2310¡Programmer did not check previous procedure declaration. 


in |сор» 
іп a previuos problen) 


ANNEX E? 
ERROR LISTING (COMMENTS) 
ERROR! DAY | COMMENTS 
# 4 TIME, 
9 ' 
3 ' 
А ' ERROR BLOCKING, etc.) 
103/09; 
ШІ 1030; 
EN! 14401! р 
35 $ 1530¡Extreme conditions not carefully analyzed. 
36 | 1615!$ате а$ 35 
37 $ 1730!Lack of concentration while coding. 
ЕВ 1730; 
39 1 20001"READ" and "READON" confused. 
40 |! 
41 ! 2200; 
42 ; 2230, 
43 ! 2340!Use of wrong oarameter. 
103/09! 
44 $; 1040:Error found while punching cards. 
8957101! 
aoe; 1600, 
4“ | 
ШІ ! 
' omitted) 
48 + 1930¡Two statements in reverse order. 
Et 2100! 
EO |! 
51 1! 22e50i:Caused by chanaing code. 
52 ! 2500! 
53 ; 2310! аск of concentration while ounching cards. 
' ı(see comment 4 4) 
50 i 2510: ѕате as 53 
55 2510!same as 55 
ШЕ | 2310!same as 53 
57 1 2310tsame as 53 
ЕВ 2510! 
59 : 
' ı (faulty invocation) 
60 ; 2310; same as 59 
103/11! 
61 | 1400, Forgotten reset of parameter. 
62 | 16204 Іғасогоогіабсе stoppina condition 
' + (confused with similar condition 
63 і 1630:tWNrong use of a subroutine. 
64 !| 1730: Еггог found using a trace. 
65 | 174Sitsame as 64 
66 ! 1810 Еггог founa during desk test. 


9 





АММЕХ Е2 Page 3 of 3 


ERROR LISTING (COMMENTS) 


COMMENTS 

(EVIDENCE, THOUGHTS, WHY WAS THE EPROR MADE? 
WHY ANO HOW WAS THE ERROR DISCOVERED? 

ERROR BLOCKING, etc.) 


ERROR; DAY 


TIME 


103/12! 
67 1 1300¡Necessary uodate of a variable left out. 
68 1 1315isame as o7 
69 ! 1520: зате as 67 
70 $ 132Si¡Booleam expression does not "eet the needs of t^e 
? ialgorithm, Error found by tracing. 
711 i 1340¡Misinterprtation of the error source. Error founa 
' rwhile repeating debugaing steo. 
72 1 1900¡Different behaviour of alagoritm for removal of 
' ¡last path previous to the last one was not consicered. 
' {Error found оу desk test of all relevant suorcutines. 
203/141 
73 1| 2000iError found during desk test. 
Ш5/15! 
Bu 1100; 
(908716! 
5 |! 


1800;Error found during desk test. 


— OS сш 





АММЕХ Е FINAL STATISTICS 


PROJECT 2 2 


FINAL STATISTICS 
Project name : PATH ANALYSIS IN DIRECTED GRAPHS 
Short description: 

This program is designed to find all possible oaths of 
minimal length (1.e. if a directed Graoh contains looos no 
looo may be traversed more than once in a row) through a 
directed graph, 

Inout: via pounch carcs Outout: via line orinter 
Quantitative measures: 
1. 3 of source statements : 712 
2. Total man hours for oroject : 125,0 
5. Man hours soent in 

a) Design : 21.0 

BI Coding : 26.0 

С) DEBUGGING : 55.0 

3) Testing : 13.0 
о СРО еу те for comovles: 206.65 sec. 
5, CPU time for cebug runs: 189.46 sec. 
o. CPU time for test runs: 859.73 sec. 
7. 2 of test and debua runs: 13 
8. 2 of test and debua steps: 43 


9. 2 of errors found: 75 


10. Total тап hours used to correct errors: 15.5 


"uo 





ANNEX F FINAL STATISTICS 


# of errors 11. Error Detection : 
Mean time between error detections: 69 man mine 


1 
' 

US sxx 
ix 
wa 
E: 
2 

40 1 x 
NE 
i 
я 
' * 

55 i я 
ES. 
а 
‚я 2 
ME 

30 i œ 
ж 
t F 
а 
l 

25 = 
+ * 
AES I 
Ж. 
! ж 

EU * 
mio» 
io s 
га 
ү» 

د 
I ok‏ 
E‏ 
EE:‏ 
mx‏ 

10 + * 
ES 
| жаз 
ot я 
t * хаяа 

EN * * * * 
пх я жя 
пя яяя хая 
! k k * дах * я 
1 |! * k r k rkt х х хх} za man hours 
capa par par por ar or pr po pr pr poro ә фо = фео фео фео фо фео фео фео фео фео фео фео фе фео фео фое ә су] 
1 2 3 4 5 6 7 a Se Oo 235613 project time 


TIME BETWEEN ERROR DETECTIONS 
(measured from point in time of aetection of previous error) 


DS 





АММЕХ Ғ FINAL STATISTICS 


12. Error Correction? 


Mean time to correct an error: 13.2 man min. 


* of 
Errors 
corrected 
7 
* 
291 ж 
; * 
I * 
IS 
251 ж 
: * 
i * 
у * 
: ж 
20; а 
у * 
' * 
! * 
I * 
15, * 
I * 
- ж 
Т * * 
i * * 
101 * * 
DN * * 
ER * * * 
Ix * * * 
гая * ж ж 
Sixx * * * 
iur * * * * 
| Хх * * * * 
| we * * * я * ж 
Les * * * * * x * ж 
-%---ғ%----%----%----%----%----%----- ть. => >>> 
1 S 10 Ds 20 25 30 60 120 180 


man minutes 
of oroject time 
TIME TO CCRRECT ERRORS 
(measured in from point in time of detection) 


RI > 





АММЕХ Ғ 


үз, 


а) 
b) 
c) 
d) 
e) 


f) 


xn nu a. 


u 


Ahen 


W # папа ou 


errors 


er Fors 
errors 
errors 
errors 
errors 


errors 


errors 


errors 
errors 
errors 
errors 
Cito to 


errors 


were 


found 
found 
found 
found 
found 


found 


were 


made 
"ade 
"made 
made 
made 


made 


found: 


during 
during 
during 
during 
during 
test p 
during 


made: 


auring 
during 
during 
during 
during 
test Dr 
aurina 


FINAL 


design ohase: 
design review: 
coding: 
debugaing: 
writing of 
rocedures: 
testing: 


desian phase: 
cesicn review! 
coding: 
debuaaing: 
writing of 
ocegures: 
testina: 


194 = 


STATISTICS 


21 
SES 


15 


75 


+ 25%544 


Mx 24 


44 3 


š 


2544 





АММЕХ Ғ FINAL STATISTICS 


15. TIME HISTORY GRAPHS : 


# of 
Errors 
T 
' 
! Error Types: 
' A: Clerical error 
! B: Debugging error 
I C: Coding error 
' D: Design error 
10+ 
' С 
' С 
' E С 
' C C 5 0 
° + C C À A 8 
' E д А С СА E 
> À С СА Е D BA DoD 
' CCC C CELE АСТА D CA CD D 
1! CEASA ВЕНЕ ED CADOCCEOA. Со о С 0 С 
Pos nfo ente ropa =} = ora o o opor opor = os opor фео фео фео фео фео фе о o oo Э man 
2 24 60 30 112 125 hours 
NUMBER OF ERRORS FOUND VS PROJECT TIME 
z of 
Errors 
Т 
i 
10» 
: * 
: * 
: * * * 
! * * * 
5% * * * * 
: * ж ж * 
n ж * жж» * * жж * 
: tax tt torz % Ree Rett ke z 
1% хжжх кез хяжх RO AAA x Fe Ro ыж * 


-—— e оз фефефеофео apo o oe apo Фе Фф = +} =» +} =: +} = + е + = +} ooo pop o popa pop nos „--+r-> man 


2 24 50 80 112 125 hours 


NUMBER OF ERRORS CORRECTED VS PROJECT TIME 


x ob 





ANNEX F 


1. 


ERROR CATEGORIES AND TYPES 


Design Errors 


The foliwing types of errors apply to both categories 
"System Design Errors" ano "Program Design Errors”: 


01 
02 
03 
04 


06 


O 
л 
oe 9% oco 00 968 968 90 99 00 


Communication Error 

Design Negliaence 

Forgotten Cases or Steos 
Timing Problems 

Errors in 1/0 Concepts 

Data Design Error 
Initialization Error 
Inadequate Checkinea 

Extreme Conditions Nealectea 
Sequencing Error 

Indexing Error 

Looo Control Errors 

Misuse of Boolean Exoression 
Mathematical Error 
Reoresentation Error 
Misunderstanding of Problem Specifications 
Other Desian Errors 


Coding Errors 


e 
іл 


Misunderstanding of Üesign 
Nealigence 

1/0 Format Error 

Misolaced Data Declaration 
Multiole Data Declarations 
Missing Data Declaration 
Inadeauate Data 

Initialization Error 

Error in Parameter Passing 
Inadeauate or Forgotten Checking 
Level Problems 

Missing Declarations of Block Limits 
Case selection error 

GO TO Problems 

Comment Error 

Forgotten Delimiter 

Inconsistency in Naming 

"rong Use of Nested IF Statements 
Indexing Error 

Inconsistent Use of Variables or Data 
Seauencing Error 

Fiag Usage Problems 

Syntax Error 

Looo Control Error 

Incorrect Exit from Subroutines 
Language Usage Problems 


zo 





АММЕХ Ғ 


Cel: 
C28: 


C29: 
C30: 
C31: 


3. Clerical 


Al 


4. Debugging 


81 
Ве 


90 0. Фо Фо 


ERROR CATEGORIES ANO TYPES 


Forgotten Statements 
Reoresentation Error 
Control Seauence Error 
Incorrect Subroutine Usage 
Other Coding Errors 


Errors 


Manual Error 

Mental Error 
Procedural Errors 
Other Clerical Errors 


Errors 


Inaporopriate Use of Oeougaing Tools 
Insufficient or Inaporooriate Selection 
of Test Cases or Test Data 
Misinterpretation of Depugaing Results 
Misinteroretation of Error Source 
Negligence 

Other Debugging Errors 


© Testina Errors 


oo 99 99 99 bb 


Inadeauate Test Case(s) or Test Data 
Misinteroretation of Test Results 
Misinterpretation of Program Soecification 
Nealigence 

Other Testing Errors 


лс» 





ANNEX G 


PROJECT 2 


Program Dart 


BuSPLEXITY MEASURES: 


STATEMENTS: 3 - 
NCDES: 


Mninn mM 
ло 0 
{> 
AD 
€ 
^ 
oo Фә 
xr ad 


SOTE: ATI 


2 


17 


33 suoroutires “ave 


Pace l of 21 


ЕБЕ ЕТЕР GRAPH DBEPRBESENTATTIOM 


ое, СОРТ, ЕОВа, SETCARI,SEICAR2, 


SECORS SET CDRA FREF; FREE; SPACE; 


ОВ ЕЕ СВЕ, SET GAME, ADDBROTHER,; 


ROTHER, МАМЕ ПЕ, PATH ІП, NAME, 


O ET UE SUCCESS SS, PSEJECESSOF, 


ЕЕ Пн ID, PUT SECT PATH= 


HEADER, SEAT FATH, PPEYTOUS РАГЫ, 


LINK FATH SAC<X“, LINwPATH, LINA FGRASQRO;, 


CREE T DUPLICATE "MODNODE., 


ALTERNATIVE IMITPATFLIST 


ү р 


l 
e Error = 43 (in МІ)МАЕЕР СЕ 
SUCCFS SONS) 
e Errem 2 45 fin PUT ЕЛІ 


кте сатте structure, 


158 - 





EUMPLEXITY 


м 


ЧОМВЕЗ OF ST 
NUMBER CF AC 
NUMBER CF AR 
NUMBER СЕ ЁД 
(ООШ АТС N 
SEACHARÍLITY 
NOCE b š 
ШЕГЕ 2 : 
NOCE 3 : 
МАССЕ 4 : 
SIONE 
me craaILITY 
HOIR ECETES 


ANNEX G 


DIRECTED 
PROJECT 2 ; 2 


Proaram oart 


EASURES» 


a ECOECODO 


ALLOCATE, 


139 - 


G2A4pu 


ЗЕРСЕЗЕНТАТТОМ 


ЕВС ТЕР 


Pace 02 of 





ANNEX G Page: 3 оғ 21 


DIRECTED GRAPH REPRESENTATION 
PROJECT 2 < 2 


Program cart : ERROR 


BEMPLEXTITY MEASURES: 


IUMBER OF STATEMENTS: оч 

ВУЗЕ СР NCCES is 

ВЕ“ CF ARCS : l^ 

УВЕЗ ČF BARS; 13 

CYCLCMATIC NUMBER: Vic)» 1 

ШЕӘССРАПВТЦПТГІТУ СР ХОПС5: 

АСЕ I | e 

NULES 2 D L 

NO C š 3 1 

КЕСЕ 4 i 

NCCE $ 3 1 @ 

NCCZ Е 2 1 

NCEE Ж” 1 

NC C C á 1 

NOCE ç 1 

SAM E e x 

ЖЕЛЕ 11 1 

NEES 12 {| 

КЕСПЕ 13 l 

NQCE 14 1 

Meee 1: I ° ) (2) 
SUM: 15.C6C0C 

RESICLÄEILITY INCEX 

СЕ OIRcCTEC unAPF 25022200 
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ANNEX G 


DIRECTED GRAPH 
PROJECT 8 2 2 
DIAGNOSE 


Program cart : 


BOMELEXITY MEASURES: 


Q 
nN 
z (Э 


Ginnnas ГЇ! 
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— w^» 
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DIRECTED GPAPH REPRESENTATION 


PROJECT E 2 2 
Program cart : SON 
MEASURES: 
ТЕЧЕТ: 15 
ANGES: 7 
ARCS : Т 
PAáTrS:; 3 С 
NUMBER: V(C)= 2 
ПУ ЕЕ с. 
< (2) 
: 1 
>o o 
: e 
: 1 
n 9 
9.202CCO 
MINE X 
C CRAFF: EEE IIS 
р 
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ANNEX G 


GREPA PEPRESE NY *TTIOM 


OTRECTED 


2 


Ф 
e 


PROJECT = 


FIND ORIGINAL 


Program oart 


БИБІРЕЕХІТҮ MEWSURES: 


Du 


NUMBER OF STATEMENTS: 


Ш 


— 


с» 


ооз >> 
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АММЕХ 6 
QIC C IED 
PROJECT z ; 
Program oart DUDITCATE 
COMPLEXITY MEASURES: 
IUMRER OF STATEMENTS: 195 
EER CF ACCES: Э 
NUMBER CF ARCS : 5 
ШІРЕЕЕ СЕ РАТЕ5: 2 
ЕТЕРЕМАТІС NUMBER: V(G)= 2 
D FA2ILITY CF ACCES: 
КОСЕ l ¢: 1 
NCCE 2 : 1 
NCCE а 2 
NCCE 4 : 1 
NCCE 2: 2 
sum: 7.-625350 
REACFABILITY INCEX 
SE DCIRECTEC GnaFFr 154522000 


GRAPH REPRESENTATION 


CURRENT PATH 





- 144 - 


pce sot cel 





АММЕХ С Pace 8 of 21 


DIPECTED GRAPH PEPRESENTATIOM 
PROJECT 2 : 2 


Proaram oart : FIND PATH 


pOMPUEXITY MEASURES: 


NUMBER 


«ім--1--1%% 


ШЕ 
СЕ 
СЕ 
СЕ 
TIC 


6 
ii 
r 


uv 
1» 
со 
Ha 
mn 
С) 
m 
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ANNEX G Pace 9 of 21 
DIRECTED GRAPH SEPGESENTATION 
PROJECT ES e 


Proaram part : REMOVE PATH 


Moe LEXITY “EASURES: 


NUMBER OF STATEMENTS: 45 . 
NUMBER Ce NCCES: 19 

NUBES CF ARCS : 25 

NUMBER CF PATHS: (2 

ESXCUCMATIC NUMSER: V(G)= 8 
EEPCEABILITY CF NCCES (2) 
NOCE 1 : 1 

NO CE Zee 1 

NOCE 26 2 

МЕСЕ 4 3 4 

КЕГЕ 5 : 2 

ТЕГЕ & $ 4 

ЕСЕ т : 4 e error 2 47 
NGCe So: á 

NCCE е: а 

NG Le ШО» 12 

КЕ РЕ 2 : 24 

КЕСЕ 13. : 12 

КОСЕ 14 ¢ ES 

б Сг pz. 3 эё 

NLCE ШЕ : Z^ 

NOCE 17 š 4E 

ШЕ la 3 7- 2 
NOCE IS: 72 


&n 
С 
ж 
. 

bas 
= 
С» 
° 

€) 
C 
O 
O 


CX 
Tun 
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DIRECTED GRAPH REPRESENTATION 


END OF PATH 


e 


18 


ANNEX G 

PROJECT s 

Program part 
MEASURES 


NUMBER OF STATEMENTS: 


COMPLEXITY 


= CIN Y UI 096 


EABTLITY 


ALE aca Z< z au ut um 


i 


(аў Error 3 52 
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АММЕХ С 


DIRECTED GRAPH 
PROJECT 2 : 2 


Prodrem oart 3 INPUT DIRECTEN 


u 


a) of nodes: 23 
О) 3 At ares : 27 


c) = of statements: 54 


а 


4) ом [су ыс t 

e) Зезсһао11 ігу: œ 

J IE C omaric RUSS: ө 
* Numcer of oaths 


ang reachability 


are very larce. 
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ЕЕ АЙ | 


GSAPH INFORMATION 


е Error 
EE. eror 
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GRAPH REPPES 


ВЕ ВЕСТЕВ 
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PROJECT в 


CETTE SUCCESSORS 


Proaram part 


E ASURES? 


BUMPCEXITY 


54 
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ч 9 


NUMBER OF STATEMENT 
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ANNEX G 


PROJECT g + 


Program cart 


VEASURES?: 


PU 


< سے‎ e ae e aD a a 
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DISECDED GRAPHOREPHESENTSTTION 


OCCURS TAICE 


Ul 


е се ЖЕ ш 
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ANNEX 6 


DIRECTED GRAPH 9SEPSESE'"ITAT ION 


ӨБЕМЛЕСІТ 2: 2 


Prearam Sart : ONE 


BUMPLEXITY *EASURES: 


ШЕЯ ОР STATEMENTS: 11 
MEE CF NCCES: 4 
NUMBER Zr ARCS : ^ 
USER CF FATES: 2 É 
meee ATIC NUMBER: V(C)= z 
EECCHASILIQ(Y CF ACOcS: 
NOCE Lo 1 
SECLE 20: E 
Necc 3 4 i 
NECS + 3 2 

SUN: 6.509929 
ШЕНСЕЗЗП ІТҮ INDEX 
Meo tksCTSl Geerr: a SUE O 


NAY 


"IET 
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DIRECTED GRAPH DEPRESENTATION 


u 
ee 
Mu 


PROJECT 


Proararm Dart T WATCHING 


5S) E O PEZ 3 1 


oe 
0 


ЭТ ares 


u 


c) 


H 


С) of Groatemenrs: 19 n 
его: * 


Вас зо ту: * 


$) Cyclamatic nuera”: 4 c 
* ^f 


Numrer cat”s 
ang reacrac1lity 
are very laraa., 
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АММЕХ C 


Page 


БІНЕЕҮЕ GRAPH NEPRPESENSTSTEO 


PROJECT 8 : 2 


Program Dart 2 CHEC<Bäck 


a) 
n) 
=) 
З) 
г) 


t 


3 of no3jes: I» 


и 


Оо К агсз < 15 


ц 


of statements; 30 
Зо O05: * 
Reachability: * 
Cyclomatic nurner: 5 

Mumoer of Oats 

and reaGmao1lity 


are very larsa. 
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АММЕХ 6 


PROJECT = >: 


Program oart 


EXSWPLEXITY NEASUPES: 
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Pace 17 07 21 


GRAPH REPRESENTATION 


> SAVE MEMOPY 


fu 
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АЧНЕХ С во! 


DISECTED G24P4 GECGESENTATION 
РЕ 2 


Program part © LIST PATH 


MOMPLEXITY MEASURES: 
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АММЕХ 6 


PROJECT 


u 
.. 


Program cart 


COMPLEXITY "EFASUPES: 


NUMBER OF S 
NUMBER CF N 
NUMBER CF å 
Екен CF FP 
AI TS 
REACFARTLIT 
NGO C š 1 
Bere 2 
қаба 2 
NGCS ó 
SUN: 
RELCRAGILIT 
me OLR ЕСТЕВ 


..-< 


40 Фә 0» 


€ 


Е. 10 
S 


< (x 41 


ға 
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t^ 


Dir hi 7 


«ар чир «ир чир e e e ow 


2 


DIRECTED 


ST 


fu 


SA Ins, 


"$9 - 


GRAPH FEPRESENTATION 


MAT SY 


c C 
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ANNEX G 


ӘТЕЕГСТЕП 
PROJECT 2 2 72 
Program салт : ANSLYZE 
COMPLEXITY MEASURES: 
NUMBER ОҒ STATEMENTS: 23 
NUNBER CF ACCES: ТІ 
NUMBER CF ARCS : 3 
NUMBER CF PATPS: 4 
2YCLCMATIC NUkRBER V(G)= 3 
EcFASILITY CF NCOSS: 
NGCE I: 1 
КІБЕЕ 2 : E 
NOCe r iL 
NGCE a o: 2 
NEL 3 м 4 
MeL = é : 2 
NOEZ ШЭ: 4 
SUM: 12200000 
EscCCPEABILITY INCEX 
QF DiRECTSE СААРН: 2 214228571 


= 157 
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ANNEX G Face 2I otf 2] 


CLRECTED GRAPH REPRESENTATION 
PRUNEE I 4 7 2 


Program Багт с SET PATHS 


а) 2 of noses: 40 


г) = of ассо * S4 e 
Er 


С) 2 с? statements: 61 


ror = oF 


f) Cyclomatic number: lo D 
я Numcer of oatas E 


and reacranitl1ty O Б” 


are very arse. 
= Error 2 nd Z О 
@ error 55 


14 39 


а 


ә) or 59842 = 


e) Reacnaoility: = 


EEO 213 9S 


e 
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АММЕХ Н 

TEST 
Project & : 2 
Test run Ё 3: 1 In 


Begin of Test (day/time) 


for necessary 
b) с) 


CPU time 
Ш 7.53 
CPU time for TEST run (s 
Man Hours for this Test 
tests) 


BEST; ОВУЕСТУЕ 


ӘТЕР; 


! 
' 
| ‚Test performance 
'of proaram for va” 
‚rious directed 
graphs: 
ia)directed graph 
!9 nodes, 10 arcs 
ib)directed graon 
16 nodes, 7 arcs 
‚c)cdirected graph 
¡6 nodes, 7 arcs 
'd)directed graon 
‚22 nodes, 25 arcs 
ie)directed graph 
102 посев, 27 arcs 
if)directed graph 
11 node, 1 arc 
i (self looo at node 
11) 
ig)directed 
12 nodes, 2 
Ih)directeo 
io nodes, 1 
' : ! 
Remarks: Directed grapns 
boundary condi? 
to be difficult 


grapn 
arcs 
graph 
arc 


Do me sm ma ғ“ ә чә ә ә чә ҸӘ Чә me a mo zu ӘӘ ӘР "o ow ma o o om o om 
. 


PHASE DESCRIPTION 


cluding ! Test § 
: 03/17/1500 


comoiles (in sec. 
d) e) 

ec) : 25.29 

runes 5.0 Cinelud 


EXBEETED 
RESULT 
(TOLERANCE) 


5 valid paths 
3 valid paths 
4 valia oaths 

7 valia paths 

{1 valid paths 
no valid cath 
warning should 
be orinteo 

2 valia paths 

l valid path 
submitted for te 


ions and special 
to examine. 


159 


Page 1 of 


tep 
End of Test 


79:21 s 


fJ 9) 


ing oreoaration of 


(day/time) ? 


03/17/1900 


COMMENTS 
AND 

CODED ERROR 
КЕРЕЗ 


1) Record «nen 
error occurs. 


1) 
ЕТО ERROR IDAS, 
RESULT, 3 ' TISE! 
! ' 4 
' ' s 
H i 15005 
' ' ' , 
' i i ' 
ВК 1 t 
ОК. | i 
O i ; 
; ' ' i 
OIN : : 
) ' ' і 
ЗЕК, ' ' 
' i ' ! 
LU eK TM ; : 
I i ' ' 
i ç ; 
' ' ' : 
г белое : І 
' ; ' i 
O |! ! ' 
' : duc S 
: ' 1900; 
sting include a variety of 


cases 


which are considered 





АММЕХ Н Page 2 of 2 
TEST PHASE DESCRIPTION 


Project # : 2 
Test run # : 1 Including 1 Test Steps 
Begin of Test (day/time) : 03/15/1200 Ena of fest €day7time) : 05/17/2200 


CPU time for necessary comoiles (in sec.): 6.83 
Ш) 6.85 b) с) а) е) f) g) 


CPU time for TEST run (sec) : 944,44 


Man Hours for this Test run : 10.0 (including preparation of 


tests) 
1) 
TEST! OBJECTVE 1 EXPECTED !ACTUALIERRORIDAY | COMMENTS 
STEP! | RESULT ‘RESULT; = TIME? амо 
: ! (TOLERANCE) | : I ! CODED ERROR 
| | | | 1 IYeES 


1) Record whan 
error occurs. 


1 , 
1 ' 
1 ' 
' ' 
1 ' 


; ' ' 

' ' ' ' 

l Find limits of theiProgram shoula i ' 13/15) 
sorogram using a list all oaths ' 11200: 
idirected graon ha-iuntil freelist Ма! і ' ' 
‘ving an infinite tis exhausted. ' ' 
¡number of oaths Uoan termination | ' ' ' 
according to the iof the огосгат ап; О.К. 1| ' 
¡definition being appropriate warn=-, ' ' ' 
¡USedo. ¡ing shoula be : ' 
} ‚printed, such ' : ' ' 
i ¡that the user can! ' ' 
} (interpret the re-! ' ' 
i ‘sults of the oath ' ' ' 
i analysis, | ' (57171 
i ' ' ' 122001 


Hemarks: Due to extensive depugging previous to testing no errors 
have been found auring the testing phase. 
Test data for tnis run are chosen to indicate limitations 
of the program oecause of the finiteness of tine and memory 
available. 
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APPENDIX C 
PROJECT DESCRIPTION 
Project # : 3 


Project title: PATH ANALYSIS IN DIRECTED GRAPHS 
SEE RESPECT TO REACHABILITY OF NODES 


Programmer : HOFFMANN 

Programming Language : ALGOL 

Programming environment: IBM/360/67,0S/MVT,8ATCH 
Design notes : see ANNEX A 

Program listing : see ANNEX B 

Coding notes : see ANNEX C 

Debuaging notes : see ANNEX D 

meror Listing : see ANNEX Е 

mumal statistics : see ANNEX F 

Graphical representation : see ANNEX G 


Test phase description: see ANNEX H 


Startino date: | MAR 77 Ending date: 17 MAR 77 


ERRERT MENT DESCRIPTION 


EN roject description? 

This program is an extension of project # 2. Тһе graph 
analyzing program as developed in project # 2 was modified 
 ЕЕСІсчІгсе the reachability of each node. A summary of 
the calculations is orinted at the end of the analysis. All 


features described in project # 2 will be unchanged. 


=o = 





Input: via punch cards 


Output? via line printer 


(For input description and error messages see project 


description of project # 2.) 
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E Programmer's background: 


a) Experience in programmina: 

Oct 1970 - May 1971 Programming courses 

May 1971 - April 1972 Module Programmer 

Мау 1970 - June 1974 Work im Test and Simulation Depart- 
ment at the 
NAVAL COMMAND AND CONTROL SYSTEMS 
COMMAND (FEDERAL GERMAN NAVY) 
Testing of tactical real] time systems 

March 1975 - Jan 1977 Student at the NAVAL POSTGRADUATE 


SCHOOL, Monterey, Computer Science 


b) Experience in testing! 


Two years of work in testing and simulation, 


C) Experience in the area of the given problem: None. 


d) Experience in the proaammina language being used: 
Experience over a period of 18 months in more than 10 
programming projects. (Total number of source statements 


produced during that time was more 4000.) 


ІІ РБ<усһоі!осіса! factors: 


a) Did the programmer like the project? Yes. 


b) How does the programmer like the programming 


= loo. = 





language? 


Favorite programming language, 


с) Was the programmer satisfied by the way the problem 
was specified? 


RIY minor criticism. 


d) How did the programmer like the programming environ- 

ment? 

ИО ЗС те5 (study room, card punch room) were not 
conducive to efficient programming because of restricted 
space, bad lighting and noise. 

e) Other factors: 

The recording of the experiment's data during the рго- 


ject affected speed and concentration considerably. 
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4. Comments on Documentation / 

Рог «һе documentation of each software development phase a 
special documentation form has been developed. These forms 
are designed to provide a firm quideline for the experiment 
programmer to record all data of interest for subseauent 
error analysis. 

- Beain and end of each step was recorded with respect to 
day and time. 

ПЕ еггог was recorded when it is discovered. The error 
ESSO then identified by а unique error number (1,20,...). 
Furthermore the time of discovery and the error type (using 
error types listed in ANNEX F) were recorded. 

- lf appropriate, comments about error discovery, reason why 
the error was made, etc. were documented in ANNEX Ee. 

= For each error the phase in which the error was made, the 
phase іп which the error was discovered and the time spent 
to correct the error was recorded in ANNEX El. 

Рог each step in any one of the software development 
phases the day/time of begin and end was recorded. In acdi- 
tion, the time (in man hours) for each step was recorded. 
This excludes the overhead used for documentation of the 


experiment data. 


oo. 





АММЕХ А 


WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEW 


STEP 
2 


PROBLEM ANO PLANNED SOLUTION 


3 

‘Analyze ways to compute the 
‘reachability inaoex for each 
‘node. 

!"In general the reachability 
! index of a node is 
iby 1 when tne node 


‘first node on an alternative 
pOoath. 

i"The reachaoility of nodes 
iwhich belong to a path wnich 
‘наз to be removed has to ое 
iCecremented oy 1 uo to t^e 
mode whicn has been the last 
ıbramen ooint on this oat^ ex- 
':Clugina the branch coint 
itself. 


f 
! 
iToo-0o«n Design: 

ға) Define additional subrou- 
' tines: 

‚= Update Reachability 

f (increment by 1) 

> Correct Reachability 

¦ (decrement by 1 for all oree 
| vious nodes uo to and exclu- 
| dina the last branch point) 
‚= List Reachability 

| (output of results) 

¡b) Define necessary chances 

i within current version 

' of the analyzing 2rogran, 


incremented 
1S added tc 
‘the current oatm or out as the 


ALTERNATE 
SOLUTIONS 


166 


PHASE 


BEFRREIEET # 5 


' ! MAN | 
{DAY !HOURSJERROR 
ITIMEI/STEPI 8 


' COMMENT 


3.0 


3719; 
18001 


3/201 
1500; 


Ф РЈ 
о о 


P UJ 
ON 


ж-- -- vo onm om 2. a. 2. m m mom = وت‎ nn. ma mn mu m "D m mm mn nn na zn nm 





Annex В 


Program Listing of Projects 5 2 and 3 
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GRAPHS ; 


ANALYSIS OF DIRECTEE 


COMMENT 


CATA DEFINITIONS; 


< uu 
=> 


WO) 
mu 


> 
a De» 
OCC ©) 
(26 «LA. 
ш- - 
ul Z< 
дс CQ. 
сс = 
I- Cun ru 
ZNI ct ل‎ 


COMMENT 


ARRAY М1(0::451); 


BITS 


COMMENT 


BITS ARRAY M2(C::40002}; 


М2; 


TENS OF Ml, 


"БЕСІ ICE OL Y 
VI] س‎ Us -al 
<1 D) = 
Jr Zu 
‚> س زلا( ے ہے‎ 
OOOO UTC 


BECIN OF LINKEL LIST 


COMMENT 
COMMENT 


POINTERS; 


"LO Cr 
Laz> 
---о 
IZLO 
а шшо 
he OL OL 
NLLN 
адо 
-UOU- 


MAX23 


РАТННЕАО; 


ac ac cx cc 
Us WU Uo 
NO 
US LILA لل‎ 
— 
= == 


perd pu ped bmi 


INTECER BRANCFE, POINT 5 


ТМТЕСЕК МАХ1, 


ABCUT TGTAL NUMBER 


% ө 


АМЕ); 


e 

E 
saq tetu 
осо Lm 
WO < = 
с ҥш чш 
OU ш > 
2 25-900) < о 


к sD 
+ art>~wo 
az Pu 
«Wu amu 
—- zanıo 


Qu rm 


e 


НЕ Z 


x x o zZ 


uu 


ea uic Ta 
Nearer 
чих < 


TES TERMINATICN/CONTINUATION ; 


۰ ONU OZO- 
N мш 0) = 
СО rI2> шел 
Y << kz Uz O 
OQ =< L SLL "ес 
W Za Ji < > IO 
p о «c-r (=-= 
کے‎ и әәә Ao 
— ZOUL aAa zZ 
— Fer OO а = 
се 
Ur Free = E 
Ше ж “ее” a = 
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АММЕХ С Page 1 of 1 


WORKSHEET FOR COOING PHASE OF PROJECT # : 3 
Beginning of Coding (day/time) : 3/20/2000 
End of Coding (day/time) : 3/21/1200 


Man hours : 8.0 (including punching of cards) 


1) 
CODING ı PROGRAM PART [ERPORIDAY | COMMENT 

BEGIN ; END i i 82 {TIME} 
DAY/TIME $ OAY/ZTIME ' ' À 

' ' ' i 11) Zecora when error is 

' ' ' | i detected. 
03/20/2000! |i Chances I i 

} (i"Suoroutines ' ' i 

03/20/2200! (пем) ' ' ' 

, % % 0 ! 
03/21/1000! i=Punchina cards | 1 11050! C19 

103/21/12001 ' ; 
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АММЕХ 0 


PROJECT # ; 


3 


Page 1 of 1 


NORKSHEET FOR DEBUGGING PHASE 


OEBUG Run 3 3: 1 


Begin of Debug Run (day/time) : 03/21/1200 


End of Debug Run (day/time) : 03/21/1520 


4 of Debug Steps incl. in Debug Run: 5 CPU time for Debug run (sec): 41.13 


CPU time for necessary comoiles (sec) : 29,98 


a) 


6.03 


Man hours for 


STEP}PROGRAM; 


PART 


Чем 
isubrou- 
tines 
¡and 
¡program 
ıchanges 


bc) 8.43 С, 269 ЕШ 7.87 е) f) а) 
this Debua Run : 3,0 (including oreparation of debua run) 
MAN 1) 
OBJECTIVE AND EXPECTED 1 ACTUAL ; DAY!HOURSFERROR! COMMENTS 
RESULT б НЕЗБЕТГТТІМЕ/5ТЕРО! -3 ANO CODEO 


I 
I 
' ERROR TYPES 


1) Record “hen 


' ` ' i 
' ' ' ' ' error 
' ' ' occurs 
“bet error free compile сово тен so e214. 1.0 . 2777 С5 
ı error тее! i | (forgotten 
! ' ' ! declaration 
: : І ! |! of variaole) 
' ' ! ' ' 
i ' ' ' ' 
' ' ' ' ' 
-repeat step 1 peos 5/21, 0,5 5 i Cea 
' огам 1515! H ' 
|| error | i : i 
i ' ! ' ' 
“repeat step 1 ' BN г, 0.5. ' 
' ‚1395; i i 
' ' ' ' ' 
-Check reachability cal» ¡wrong ӘТ О 054 | Ce) 
culation for trivial cases:branch= 11400) H ' 
i point | j - 
icalcula- | ' H : 
ition ' ' ' ' 
' ' ' i L] 
“repeat step 4 - ВИО, 0.51 ' 
' 11450; ! ' 
' / i i ' f 
1 f i 4 ! 
i 13/21! ' ' 
i 11520; ' i 
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АММЕХ Е Page 1 of i 


ERROR LISTING 
PROJECT 4 : 3 
Begin of Project (day/time) : 03/19/1500 
End of Project (day/time) : 03/23/2300 


Man hours for total project : 33.0 


ERROR: PHASE 1 РНАЗЕ ' ERROR 4 TIME ; 8 of OTHER 
й ı in which, in which, TYPE ;spent to 4| STATEMENTS OR 
TERROR wasiERROR was: (see ANNEX F) ‘solve the} PARTS OF THE 
‘ dis- ' made ' ( ERROR i PROGRAM 
ı covered i| ' ı (Man ! AFFECTED 
' ; ' I min.) ! 
E e» os o o o o a «P X» UP «о o» o re A э ч "DP UP OD UD ар «ер «ғ «ер D чш D чә ч «<р «ы «о «ә а Gm ар mm m So ш шо а 
ШО Coding ; Coding | C19 i 10 : 
e Debugging: Coding ; C6 | 5 ' 
3  iDebuggingi Coding ! С22 i 5 : 
а  iDeougaing: Coding . Cel ' 20 : 
' ' ' ' ' 
7 
ERROR LISTING (COMMENTS) 
ERROR! DAY ! COMMENTS 
Я ' TIME, (EVIDENCE, THOUGHTS, nHY WAS THE ERROR MADE? 
' 1 WHY AND HOW wAS THE ERROR DISCOVERED? 
' ¦ ERROR BLOCKING, etc.) 
= T n «ы «о P XD OD ер «в COD CD «а XD OD CD CD GOD e o o o ар ар ар «ер «в ap DP 4m ap em Фр Da ер ное. @& - «P P D GOD «в XD OD «о «е «о «е YD oam 
04/21! 
1! 1115!) Checking code while ounching cards. 
2 ! 1215! Found through comoiler diacnostics. 
EE 1215; 
4 ; 1400; Found bv interoreting results of debug run. 


= = 





АММЕХ Ғ FINAL STATISTICS 


PROJECT ¥$ 


FINAL STATISTICS 
Project name : PATH ANALYSIS IN OIRECTEO GRAPHS 
WITH RESPECT TO REACHABILITY CFE NODES 
Short descriotion: 

This project is an extension of project 22. The graph 
analyzing oroqram developed in project 2 2 is modified to 
calculate the reachapility of each ingaivigual node. At the 
ena of the analysis the reacnaoility index of each node is 
printed. All features of tne program being chanaed are 
oreserved. 

Inout: via punch cards Outout: via line Printer 
Quantitative measures: 
1. 8 of source statements : 70 (including necessary changes) 
2. Total man hours for project : 33,0 
3. Man hours spent in 
а) бежал : 7.0 
b) Coding : 4.0 
с) Debugging : 3,0 
а) Testing 7 19.0 
4. CPU time for compiles: $4.08 sec. 
S. CPU time for debug runs: 41.13 sec. 
6. CPU time for test runs: 391.48 sec. 
7. 8 ОҒ test and debug runs: 4 
8. 3 of test and debug steos: B 


9. 2 of errors found: 4 


10. Total man hours used to correct errors: 0.7 
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ANNEX F FINAL STATISTICS 


, 


U Error Detection: 
Mean time between error detections: 43.3 man min. 
# of 
errors 


ft kW. k... k. x n, k... 
* * * * 


ч» «» «> ф «> «> «о «> «о ф «в CP a» CP c ф « a» oam am cm db c com cR am ф чо чо ео е еә фео «> «о «5 ч» 4p c» cm 4m чо чь ф чь чо чо чо чо ф чь чь чо чо чь чо y man mi n of 
lass % 0 4 5 6 0 > 9 0 105 120 135 project time 
TIME BETWEEN ERROR OETECTIONS | 
(measured from point in time of detection of previous error) 


le. Error Correction: 


Mean time to correct an error: 10.0 man min. 


8 of 
Errors 
correc ted 
7 
t 
5% 
í хм 
1! ж * * 
- ч» ч» ч» ч» 4 ч» ч» ч» ч» фео <> «в «ы ф «> «> <> <> ф <> «> «р ч» 4 o $ ҹә ә еә фә ҹә m bou cm cm cm ф ә ҹә c» «m j+ «в «> «> «> «о «> ҸӘ ҸӘ «5 mau > 
1 5 10 15 20 25 50 35 40 man minutes 


of project time 
TIME TO CORRECT ERRORS 
(measured in from point in time of detection) 
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АММЕХ Ғ 


13. 


а) 
b) 
c) 
d) 
e) 


f) 


a) 
о) 
С) 
а) 
е) 


f) 


When 


ut RRR % 


When 


H 4 u An эц 


errors 


errors 
errors 
errors 
errors 
errors 


errors 


errors 


errors 
errors 
errors 
errors 
errors 


errors 


4ere found: 


found 
found 
found 
found 
found 


found 


were 


nade 
made 
тасе 
тасе 
made 


made 


FINAL STATISTICS 


during design phase: 0:27 0,40 
during design review: 0:2: 0.0 
during coding: |o 25.0 
during debugging: 3 < 75.0 
during writing of 
test procedures: Ши 7020 
during testing: 0-2 0.0 
ü 
made; 
during Jesiam phase: 0 = 0.0 
during design review: ОО 
auring codina: g = 100 
during decuaging: 9.9.9 
during writing of 
test orocedures: ОСЕ 0 
during testing! 0 = 0,9 
4 
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ANNEX F FINAL STATISTICS 


Bas TIME HISTORY GRAPHS : 


2 of 
Errors 
7 
' 
- Error Types: 
| A: Clerical error 
' В: Debugging error 
' C: Coding error 
- ÛU: Design error 
5» 
! 
' 
' 
1; СЕ oC 
е фефефефефеофе фео феофефеофео фео фео феофе фео фео феофеофеофеофеофефео феофео фео фе фео фео фео фео фео > man 
425345 10 15 20 25 50 35 nour: 


Не ВЕБЕ. ТЕЗІГІМС..;,........-.....---.---..-- 
(software develooment gnases) 


NUMBER OF ERRORS FOUND VS PROJECT TIME 


я о? 
Еггог$ 
T 
5% 
1» Coc X. E 
tert re ++ are + tage ja je tage tra re terre rege tere re tete + е» фефежфефе> тап 
12335 10 19 20 25 30 973 hours 


NUMBER OF ERRORS CORRECTED VS PROJECT TIME 


Sa 





АММЕХ Ғ 


ERROR CATEGORIES. AND TYPES 


1. Oesign Errors 


The follwing types of errors apply to both categories 
"System Design Errors" and "Program Design Errors”: 


о 
іл 
ә ев да де ете де ее эе ге 


Communication Error 

Design Negligence 

Forgotten Cases or Steos 
Timing Problems 

Errors in I/O Conceots 

Data Design Error 
Initialization Error 
Inagequate Checking 

Extreme Conditions Neglected 
Sequencing Error 

Indexing Error 

Uoop contro! Errors 

Misuse of doolean Exoression 
Mathematical Error 
Representation Error 
Misunderstanding of Problem Scecifications 
Other Design Errors 


0. Coding Errors 


СҰ 
л 
ғ. ве вв ве оо 99 ге е д 


Misunderstanding of Design 
Мед | 1депсе 

I/O Format Error 

Misplaced Data Declaration 
Multiole Data Declarations 
Missing Data Declaration 
Inadequate Data 

Initialization Error 

Error in Parameter Passing 
Inadequate or Forgotten Checking 
Level Problems 

Missing Declarations of Block Limits 
Case selection error 

GO TO Problems 

Comment Error 

Forgotten Delimiter 

Inconsistency in Namina 

Wrong Use of Nested IF Statements 
Indexing Error 

Inconsistent Use of Variables or Data 
Sequencing Error 

Flag Usaae Problems 

Syntax Error 

Loop Control Error 

Incorrect Exit from Subroutines 
Languaae Usage Problems 
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АММЕХ Ғ 


527% 
C28. 
C293 
C30: 
C31: 


3. Clerical 


A1 
Ae 
А3 
Ад 


4. Debugging 


81 
Ве 


53 
Ва 
B5 
R6 


ә. әс .. өз 


ERROR CATEGORIES AND TYPES 


Forgotten Statements 
Representation Error 
Control Seauence Error 
Incorrect Subroutine Usage 
Other Coding Errors 


Errors 


Manual Error 

Mental Error 
Procedural Errors 
Other Clerical Errors 


Errors 


Inavoropriate Use of Debugcinma Tools 
Insufficient or Inaporooriate Selection 
of Test Cases or Test Data 
Misinterpretation of Debugging Results 
Misinteroretation of Error Source 
Nealigence 

Ortner Debugging Errors 


Se. Testing Errors 


= 
in 
00 әФ әз әс oe 


Inageauste Test Case(s) or Test Data 
“isinterpretastion of Test Results 
“Misinteroretation of Program Specification 
Negligence 

Otner Testina Errors 


о 





ANNEX G 


PROJECT 2: 


Program oart 


COMPLEXITY MEASURES: 





USER OF STATEMENTS: 10 
EES CFE ACCES: 4 
DUNE SS CF ARCS: 4 
BUNS ER Cf FATES: 2 
SEAT IC NUMBER: V(C)= 
EESGEASILITY Cr NCOES 
NOLS 1: 1 
NCCE 2 2 
INGE = a 1 
ACCE 4 2 

50м: 5.552039 
HEGCHABILITY INDEX 
ee ӘТЗЕСТЕГ GRAPH: 


DIRECTED GRAPH ЭЕРБЕЗЕКТАТТОЫ 
5 


ЖРОКБЕСТБЕДЕНАДЕТЕГІГҮ 


г 


.5СС000 ; 


=ч OX 


Page 


1 


of 


„з 





АММЕХ С 


DIRECTED 


PROJECT E : 3 


Program cart 


COMPLEXITY! MEASURES: 


NUMBER ОЕ STATEMENTS: 3 
NUMBER CF ACCES: 2 
AUMBER CF ARCS : 1 
NUMBER CF FATFS: 1 
CYCLCMATIC NUMBER: V(G)= 1 
ECSCPABTILITY CF NCOES: 
МОС 5: 1 
NE EE 2 1 
SUM: 22552099 
ШЕКЕ ГЕН [ТҮ ІМГЕХ 
CF DIRECTEC СҒКАРР 15210399 


202 


GRAPH 2EPRESENTATION 


ШЕРАПЕСКЕАСЯАВТЕТТҮ 


Раае 


ЕЕ 


5 





ANNEX С P3ae 3 of 5 


BIRELTED GRAPH REPRESENTATION 


PROJECT 4 : E 


Program part : EISTZRFEACHARSTLETY 


ЕЙМЕЗЕХІТТҮ YEASURES: 


ВЕРА ОР STATEVENTS: 13 
NUMBER CF NCCES: 4 
NUMBER CF ARCS : р 
NUMBER CE раАТ 5: 2 
CYCLEMATIC NUMBER: (3) = 2 
ЗЕАСРАЕТЕТТУ CF ACDES: 
NOCE |: l 5 
NCCE 2 5 2 
КССЕ 3 1 
NGCE 7 MES 2 
SUN: &«CC300C 
RERCEABILITY INCEX — 
F DIRECTEC GRAPE: Ie feo Sd 





= 205 - 





АММЕХ Н Page 1 of 3 


TEST PHASE DESCRIPTION 


Project # : 3 
Test run & : 1 Including 1 Test Step 
Begin of Test (day/time) : 03/22/1000 End of Test (day/time) : 03/22/1800 


CPU time for necessary comoiles (in sec.): 8.33 
ЕЕ” 9.55 pb) e d) e) f) а) 


CPU time for TEST run (sec) : 80.74 


Man Hours for this Test run : 3.0 (imeludina oreparation of 


tests) 
1) 
BEST ! CBJECTVE EXPECTED 'ACTUAL'!'ERROR!DAY {| COMMENTS 
STEP} ¦ RESULT RESULT; ИМЕ: АМО 
і ı (TOLERANCE) ç ' ' ‚ СОБЕО ЕБКОВ 
' ' J ' i | BY PES 
; ' : ' ' ı 1) Record when 
| i ' ' ' н error occurs. 
1 !Comoare results ‘Program oerfor= i1 0.5.) 13/22.: 
lof previous test imance should not | : 1000, 
{runs with results ¡be changed with | ' ' ; 
'of modified vers- ¡resoect to oath | ' і ' 
!ion of the orogramianalysis as being, ' ' ' 
¡using same inout 15сесі?біес 1п ого-, ' ' ' 
‚data. "psctos 2; ' ' ' 
i ‚Additional out- | ' ' 
' put (such as cy- | ' ' ' 
: iclomatic number | ' ' 
: lama reachability ! ' ' ' 
' (index) must be ' ' 
' verified by desk | ' i ' 
: ıcheckina. ' ' ' 
i ' i i 13/22! 
| ' i 118001 
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АММЕХ Н 


TEST PHASE DESCRIPTION 


Project #: 3 
Test run # : 2 


Begin of Test (day/time) : 03/22/1800 


CPU time for necessary compiles (in sec.): 


а) 7.90 b) c) d) e) 


CPU time for TEST run (sec) : 139.00 


Including 1 Test Steo 


Page 2 


of 5 


End of Test (day/time) : 03/23/1800 


7.90 
f) 


g) 


Man Hours for this Test run : 8.0 (including oreoaration of 


tests) 
TEST! OBJECTVE ! EXPECTED 
STEP | ( RESULT 
' | (TOLERANCE) 
' ' 
— °° , e «е «е «ӘР m m оар ao «ш чє еш чє оеш чш рр «ш D XD ow XD ow ce e ow e 
8 ! 
' ' 

1 ¡Compare hand cal- ¡In cases of dise- 
'culated results of ícrepancies pro- 
ıNTDS subroutines igram Shoulc oro- 
той module 1 with ¡vide the correct 
‚program results. ¡answer otherwise 


¡Check for discre- ¡results must 
‚pancies (if any). ımatch. In case of 
ıdiserepancies ге- 
sults must be 
(verified by desk 
checking. 

9 


= 205 


ACTUAL ERROR IDAY 


IRE SUT: 


ew ee ow an ow A A wa as oe mm mn mn nm 


@ 


' 
1 
1 
! 


ew ew D XD ce db bum db um A a DD A A o oo 


12) 


g | 


TIME 


COMMENTS 
АМО 

CODED ERROR 
ТҮРЕЗ 


1) Record «hen 
error occurs. 





ANNEX H Page 3 of 3 


TESI PHASE DESCRIPTION 


Project 3 : 3 
Test run # 3 3 Including 1 Test Step 
Begin of Test (day/time) : 03/23/2000 End of Test (gay/time) : 03/23/2300 


CPU time for necessary compiles (in sec.): 7.87 
ES 7.87 b) c) d) e) f) а) 


CPU time for TEST run (sec) : 171.74 


Man Hours for this Test run : 3.0 (including oreoaration of 


tests) 
1) 
TEST! OBJECTVE | EXPECTED ' ACTUAL ! ERROR!DAY ! COMMENTS 
БИЕР | i RESULT “RESULT: 2 ГГІМЕ! AND 
' s (TOLERANCE) ' ' i : CODED cRROR 
' : ' | ' ТҮРЕ$ 
' ' ' ' ' ı 1) Record „hen 
' ' ' ' i i error occurs. 
1 Compare hand са!” iIn cases of dis- í O.K. у 13/2%; 
'cCulated results oficrepancies pro- | | 12000} 
ІМТО5 subroutines  igram shoulc oro- | i : | 
‚of module 2 with ivide the correct i ; i 
iDrogram results. ¡answer otherwise 1| ' ' i 
ıCheck for discre- iresults must ' ' ' ' 
ipancies (if any). imatch. In case of; ' i ' 
' Igiscrepancies rea} ' i ' 
i ‘sults must be ' ' i ' 
| ¡verified by desk | ' 3703, 
' ıchecking. ' ' 123001 
3 4 ' $ ' 
0 t з ' ' 


ея = 





АРРЕМОТХ 0 
PROJECT DESCRIPTIDN 
Project # + 4 
Project title: DATA RETRIEVAL SYSTEM 
Programmer : HOFFMANN 
Programming Language : ÁLGOL 


Programming environment: IBM/360/67,0S8/MVT,BATCH 
and TIME SHARING (CP/CMS) 


Design notes : see ANNEX ^ 

Program listing : see ANNEX B 

| Coding notes : see ANNEX C 

Debuaging notes : see ANNEX D 

Гог Listing : see ANNEX E 

Final statistics : see ANNEX F 
Graphical representation : see ANNEX G 


Test ohase description: see ANNEX H 


Starting date: 19 APRIL 77 Endina Саге MAY 77 


EXPERIMENT DESCRIPTION 
1. Project description: 


А, General Description 

Тһе program is designed for usage under CP/CMS, It 
expects an input file labeled "DBASE INPUT" to contain data 
base information of the format described in section B. 


During initialization all data base information is read 
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into 
the 


func 


ject 


is p 


Program memory. After this the user may operate upon 
data using functions as described іп section С. A11 
tions are input via terminal. 


Most of the terminology being used throughout the рго- 
is поп standard. Therefore the following explanation 
rovided for better understanding: 
БИО BASE MEMBERS see description under B. l. 
b) ATTRIBUTE VALUE PAIR: see descrioetion under B. 2. 
c) MEMBER ID: The program assigns a MEMBER ID to each 
data base member depending on the input sequence. 
MEMBER IOs are integers (1,2,3 .,..). The MEMBER ID can- 
not be changed by the user, however, it may be used to 
reference any particular data base member, 
d) ATTRIBUTE IO: The program assigns an ATTRIBUTE ID 
to each new and distinct ATTRIBUTE NAME being entered 
during the initial inout of the data base members. 
ATTRIBUTE IDs are integers (1,2,...64) depending also on 
the input sequence. Each ATTRIBUTE ID is associated 
which a unique ATTRIBUTE NAME and provides a way of 
referencing any particular ATTRISUTE NAME (see section C 
ШЕТӘТД”), 
e) ATTRIBUTE NAME: An ATTRIBUTE NAME is a character 
string of length 1-64 oreceding the ":" in the input of 
an ATTRIBUTE VALUE PAIR (see B. 2.). 
f) ATTRIBUTE VALUE: An ATTRIBUTE VALUE is a character 


ЕЗІП following the ": in the definition of ап 





MIURA TES VALE PAIR (see B. 2.). 

9) KEY ATTRIBUTE: Тһе KEY ATTRIBUTE refers to the 
second distinct attribute name being input. (The second 
attribute name has been chosen because the main usage of 
the program will have data base members which are iden- 
tified uniquely by their second attribute value pair.) 
Therefore the ID of the KEY ATTRIBUTE is initially 2, 
however, this тау be changed by the user to any other 
ATTRIBUTE IO Бу using the function "KEY" (see section 
e). 

The KEY ATTRIBUTE is not always the "key attribute" in 
the sense being used in most data bases, because it does 
not necessarily allow a unique identification of al} 
data base members. (Instead the MEMBER ID can be viewed 
as internal key which always allows a unique identifica- 
tion of each individual data base member.) 

h) CONTROL: If a data base member is taken into con- 
trol by using the function "CONTROL" an internal refer- 
ence is set by the proaram which allows subsequent exam- 
mation of ATTRIBUTE VALUE PAIRS of this particular 


member by using functions "FA" and "ATTR", 
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Input Format: 


li. Description of a Data Base Member: 

A data base member is defined by İi - 64 different 
attribute value pairs followed by the termination symbol 
"я". After the last data base member an additional ter- 
mination symbol has to be inserted. 

2. Description of Attribute Value Pairs: 


Each attribute value pair has the followina format: 


<attribute name>:<attribute value>? 
where "attribute name" is a character string of length 1 
ЕСІ otesncuiuding "*" and attribute value” iS one of 
the following types: 
a) <single discrete value> 
A single discrete value is a character string of 
length 0 = n, where n is limited by tne amount 
of memory available (see section 0). 
A character string of length 0 will be replaced 
internally ру "xxx" and specifies an unknown 


value. 


b) «$«multiple discrete values>> 

Multiple discrete values are any number of sine 
gle discrete values separated by ",". The total 
string length of all values including separating 


"n" 
, 


may not exceed 64. 


ЕРО Е 





ce) <d<range value>> 
A range value is a string of length 6 = 64 of 
the format: 

<] омег limit> TO <upper limit> 


where "lower limit" and "upper limit" are in- 


teger values and «lower limit» «-z «upper limit». 


Examples: 


a) Attribute value pair with single discrete 
value: 
NAME:SMITH# 
b) Attribute value pair with multiple dicrete 
values: 
CHECKING ACCOUNT:$804020,500338 
c) Attribute value pair with range value: 
MONTHLY PAYMENTS:3550 TO 725% 
3. Number of data base members: 

The data base may contain 1 -150 members depending 
upon the amount of memcry being used for the storage of 
values (see section 0). 

4. Termination of input: 

In order to terminate the input of data base infor- 
mation an additional termination symbol ("#4") has to be 
inserted after the the termination symbol of the last 


data base member. 


ell 





5. Reserved characters: 
A r or c res her than “sr ",", "g", "S", and 

"a" may be used without restriction. 
6. Sample input: 

NAME SMEYER# FIRST NAMES JOE# AGE3574% NAMESSMITH2 

FIRST NAME:MIKE# АСЕ: ## NAME :NEWMANA 

FIRST NAME:MARY ANN# AGE: 34424 
NOTE: 
a) Between attribute value pairs any number of blank 
characters (0,1,2,...) will be ignored by the program. 
о) Any number of blank characters preceding a value wil] 
be ignored. (In the example the age of the last data 
base member will be stored as "34”.) 
с) Any number of blank characters greater than one 
within a value or attribute name will be reduced to a 
single blank. (In the example the first name of the last 
data base member will be stored as "MARY ANN"and the 
attribute name of the second member will be stored as 


"FIRST NAME" although it was input as "FIRST NAME" ,) 


"ce 





E. Function Commands: 
1. Functions without input parameters: 


INPUT | FUNCTION DESCRIPTION 


; All attribute names are listed togetner with their 
¦ ATTRIBUTE ID. (For usage of ATTRIBUTE ID see 
pet ons "АТТЫ? and "KEY",) 


ШІЗІС í All available commands are listed. 


; All data base members are listed printing all of 

( their attribute value pairs together with MEMBER 

¢ ID of each data base member. (For usage of MEMBER 
CID See functions “CONTROL” and "LISTM",) 

LISTALL | All! data base members are listed printing only 

ı their KEY ATTRIBUTE and its value preceded by the 
ı MEMBER ID. (For usage of MEMBER ID see functions 

wer ага VEIST" The KEY ATTRIBUTE is the 
{i second attribute of the first data base member 

ı by default and may be changed by using the 

UNE tion "KEY".) 

SWITCH ı This allows the user to direct the subseauent 

i output from terminal to a f1l]e labeled "DBASE 

| OUTPUT" or or vice versa. To change the output 

ı from terminal to file might be appropriate if 

‚ large output is expected. The contents of the 

ı output file may be obtained using the CMS command 
“OFFLINE PRINTCC DBASE OUTPUT". 


> 2|5 = 





2. Functions which require only one input parameter: 


INPUT OF! PARAMETER ' FUNCTION DESCRIPTION 
FUNCTION! 
-------- {+ = = = = = = == = © = = ооо фет е ч» е ч е ч» ч» чю «р ч» ч» чэ =» «з» э «з» ч» чю «р ч» «э» чю ч» аз ч» “р ч» Ф Ф е чю аз чю аз эз ч ав о эз аз 
LISTM ¡ «MEMBER ID» ; All attribute value pairs of data base 
‘must be integer! member specified by MEMBER ID are listed. 
-------- %Ж----------- ото фо еее Фе Ф Ф е е е еә фе е е ә = = = = ч = ч = чэ = ч» = «э «э э аэ = аэ з» 
CONTROL | «MEMBER ID» | Program takes data base member specified 
'must be integer! by MEMBER ID into control. (For usage of 
' I this function see functions "FA" and 
i ATTRA.) 
“Á. ———o oo ео фео е ео ooo ooo oo ooo ooo ooo ooo ooo oom 
ATTR <ATTRIBUTE ID> | List value of attribute specified by 
¡must be integer, ATTRIBUTE ID of data base member in 
' ı control. (To select proper ATTRIBUTE ID 
' ! see function "LISTA". To take a member 
' | into control see function "CONTROL".) 
-»»-е--е-)---------- - -— - -- ч» =» «э ч» ч» ч» ч» =» «з ©з «э == «э чт == а “> «> “> чә «= =» аз =з ч» =» «э =» от эз «э чэ oo ooo 
ҒА {<ATTRIBUTE | List value of attribute soecified by 
' NAME>? ATTRIBUTE NAME of member in control. 
‘must be a chaz ¦ (To take a member into contol see 
(гасег String 1 Гепсктіогр "CONTROL". To Select an existing 
iof length 1-63 | ATTRIBUTE NAME see function "LISTA",) 
followed by ":"} 
-————— - { = += ——— JM je om -————————-—-- 
KEY {<ATTRIBUTE ID» Change key attribute of data base to 


attibute specified by ATTRIBUTE ID. 

(For usage of key attribute see functions 
"ET STAGE” Sand “FIND ID". To select an 

I aJ IPT [E ID see function “LISTA”.) 


' 

% 
ımust be integer! 
: 
| 
3 
} 


Note? If parameter is required to be an integer апу other 
input will force the proaram to terminate. Other wrong 
input will cause an aporooriate error message. 
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me FIND and FIND ID: 
a) Function Descrition: 


These two functions allow the user to find all data base 
members which satisfy 1 thru 4 conditions specified бу 
Subsequent input. (By a condition is meant an attribute 
value pair. À member satisfies the condition only if it 
owns this particular attribute value pair or if it owns 
the attribute without a value specified. Тһе latter 
case will be indicated by printing "*xx5" as attribute 
value in the outout following a query.) After the condi- 
tions have been input the program tests al! data base 
members as to whether they satisfy all conditions. Only 
those members which satisfy all conditions of the query 
are listed. Using "FIND" all of their attribute value 
pairs are printed whereas using "FIND ID" only the key 
attribute and its value is printed. (lo change the key 
attribute of the data base see function "KEY".) If no 
conditions are entered all data base members will be 
listed. 


СОО Input of Conditions: 


CONDITIONS 1-4: 


Input of <ATTRIBUTE NAME> | Input of «attribute value» 

=» =» =» жэ =» =» =з =з ш» чэ =» a» P чә тз чә => =» чә ш» "D «P «m «Dp wp еә Ф ф ею чр ею е» чэ аю o еэ «э =» е» ер se чэ ер еэ чэ еэ ер qub UD UD UD GR ар Фр Әр Әр Чэ Gu» Әә Gu» UD WD GP Әр Gm m 
ATTRIBUTE NAME can be any {f Within queries attribute values are 
string of length 1-63 ı restricted to ре 1°64 characters. (If 
morrowed by "3s" (it is ' the value stored is longer than 64 
necessary that the ı characters the comparison is only 
ATTRIBUTE NAME matches with; carried out up to the last character 
one of the existing ; of the query value. ) 

ATTRIBUTE NAMES) ı Since all values are stored without 

If an ATTRIBUTE NAME cannot; preceding blank characters the query 

be found an error message ı value should not have blank characters 
is printed and the user can, in front of the value to be tested for, 
repeat the input. i 


c) Termination of Query Input: 


User inputs: 
Q 
d) Sample Input for FIND and FIND IO: 
FIND 
NAME: 
SMITH 
АСЕ: 
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ae 
Q 


FIND ID 

AGE: 

104 

Q 
NOTE: 
E AII input for all functions must not be preceded by 
blank characters. 
m Each input has to be on а separate line. The input is 
entered by hitting the carriage return key. 
D, Limits of the Program: 

The total number of different attribute names may not 
exceed 64, Assuming 100 data base members having 64 attri- 
butes each, the overhead used for imolementation (65 items 
for each data base member) would reduce the amount allocat- 
able items of M2 (20,000) to 13,500 items. Each item of Me 
can be used to store 1-4 characters, The number of remain- 
ing items divided by the number of data base members gives 
the average number of items available for each data base 
member ( approximately 135). Thus the total amount of 
remaining storage locations allow approximately 24,000 char- 
acters for values which means that the average string lengtn 
of values will be less than 8. The program assumes that at 


least two different ATTRIBUTE NAMES are entered. Jf this 16 


not true the user has to chanae the KEY ATTRIBUTE to "1". 


Е. Error Messages: 
All error messages are self exolanatory. Error #1 and 


# will cause the program to terminate. This will be the 


a clos 





case when all memory locations are exhausted (error Z1) dur- 
ing the input of data base information or more than 1000 
members are specified (error # 2). 

Error #3 indicates that an attribute name is longer than 
63 characters. (Іп this case the problem might be solved by 


examining the input file.) 


- 217 - 





2. Programmer's background: 


a) Experience in programming: 

Oct 1970 =- May 1971 Programming courses 

May 1971 = April 1972 Module Proarammer 

May 1972 - June 1974 Work in Test and Simulation Depart- 
ment at the 
NAVAL COMMAND AND CONTROL SYSTEMS 
COMMAND (FEDERAL GERMAN NAVY) 
Testing of tactical real time systems 

March 1975 - Jan 1977 Student at the NAVAL POSTGRADUATE 


SCHOOL, Monterey, Computer Science 


b) Experience in testing: 


Two years of work in testing and simulation. 


c) Experience im the area of the given oroblem: 
Usage of similar data structures in previous programming 


projects. 


d) Experience in the oroaamming language being used: 
Experience over a period of 18 months in more than 10 
programming projects. (Total number of source statements 


produced durina that time was more 5000.) 


Psychological factors: 


a) Did the programmer like the project? Yes. 


e = 





b) How does the programmer like the programming 
l anguage? 


gavorite programming language. 


C) Was the programmer satisfied by the way the problem 


was specified? 


ШЕШІМ minor criticism. 


d) How did the programmer like the proaramming environ- 

ment? 

The facilities (study room, card punch room) were not 
conducive to efficient programming because of restricted 
space, bad lighting and noise. 

e) Other factors: 

The recording of the experiment's data during the pro- 


ject affected speed and concentration considerably. 
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4, Comments on Documentation 

For the documentation of each software development phase а 
special documentation form has been developed. These forms 
are designed to provide a firm guideline for the experiment 
programmer to record all data of interest for subseauent 
error analysis. 

- Begin and end of each steo was recorded with respect to 
day and time. 

- Each error was recorded when it is discovered. The error 
was then identified by a unique error number (1,20,...). 
Furthermore the time of discovery and the error type (using 
error types listed in ANNEX F) were recoraed. 

- If appropriate, comments about error discovery, reason why 
the error was made, etc. were documented in ANNEX Ee. 

EN Or each error the phase in which the error was made, the 
phase in which the error was discovered and the time spent 
to correct the error was recorded in ANNEX El, 

- For each steo in any one of the software development 
phases the day/time of begin and end was recorded. In addi- 
tion, the time (in man hours) for each step was recorded. 
This excludes the overhead used for documentation of the 


experiment data. 


E 
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WORKSHEET FOR DESIGN PHASE ANO DESIGN REVIEW PHASE OF PROJECT 8 4 


' ' i | МАМ 1 ' 
STEP! PROBLEM AND PLANNEO SOLUTION ¡| ALTERNATE {DAY !HOURSJERROR| COMMENT 
Б! ¦ SOLUTIONS ThiMes/ Stee, 47% 
1 {Analysis of reauirements of 74/19) ! 
‚project. 11800, 5.0 


Storage in fixed 
lenaths string 
arrays would 
«aste too much 
memory, 


("Since almost all expected 
(values are of different length 
¡usage of linked lists for sto- 
¡race of all attribute values 
¡seems to be aporopriate. 
¡"Study of I/O caoabilities un- 
¡der CP/CMS. 

¡“View of data base members: 
¡Each data Dase member has a 
'tunigue identifier (member 2). 
¡For each member тах. 64 diffe-¡a) Let number of 
¡rent attribute value pairs can ¡different atetri- 


¡De defined by imput. Maximum ıbutes be an ine 
iString lenatn for any attri=- ¡put oarameter. 
ibute is 54, The total number ib) Use a hash 


‚of different attributes in thejtadle to store 
¡data oase may also not exceed ¡attributes. This 
{64 (arbitrarily chosen limit).iwoulc make 
‘string lengths 
sof attributes 
ıindevendent of 


ition to be stored in the data 
'Базе.) 


теь ==» oo wa b 4D Sa a ga mm mm mo dm mc ӘӘ ҹә Әәә Gm Gm 4p 4b wb X "m 4e 4b 4b 4e D De bam 2. 2. 2 Әәә чә ә Әәә os ә еә ӘӘ аә Әә ә Әә Әә a аә ә ӘӘ аә ӘӘ Әә ӘӘ ә ә аә аә Әә чэ» oa 


¡the array size 4/19 

fof the attribute! 1900 

‘table. 

' 

' 

2 ¡Define data structures: : 4/19; 4,0 

("Attributes are identified by 1 1900 
ta character string of lenath | 
‚64 and stored in a String ' 
'аггау (ATTRIBUTE). ' 
¡Each attribute can be uniquel y! 
¡identified by its position І 
¡within the attribute array ' Primitives 
(ATTRIBUTE ID). ' for data 
is Values ot attributes are ' ıstructures 
‘stored in a linked list struc-| ¿could be 
fture using a BITS ARRAY (M2). | ıcopiedfron 
¡(Length of M2 (124,000 bytes) | 4/19 ‚project 
¡limits the amount of informa” | 0900 но. 

4 

' 

' 


Remarks: see page la 
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Remarks: 


a) Linked list of data base members: 


3 % ' ' ' 1 
t ! 1 1 ' ' 
! ' 1! ! i 2! n! 
1 ' t t ' ' ' ' ' 
J БЕР рге е - == о> f Der ‚Dtree=-=-=-> алата : Str : NIL 4 
t t Li 1 t ! $ t 1 1 1 1 
, t ' 
, t ! 
у у V 
attribute value attribute value attribute value 
list of member l list of member 2 list of member n 


(last member) 


о) Structure of attribute value lists: 


lass. - -—— — : ' ' н Md DA Da i жа та че a 
i ' Al; ' ' А2! ' ı Aln)ı 
1 weane ! ое! raros rr rs! 1 шс чо о ° cenea ! 
' ' ' ' , 1 ! ! ' 
| ptr Ое - === === ео > t Str fotress<«<=> ae Н ОСГ ' FADE i 
1 , ' ! t ! ' ' , t ! ! 
' ' ! 
1 1 ' 
V V V 
value structure value structure value structure 
of first attribute of secona attribute ӨР пет асеттейсе 


where Al, A2,... represent the ATTRIBUTE IDs of corresoonding 
values 


с) Value structure: 


t 
t 


tI NIL 


' ' ' : 
' ! 1 
3 ' 


¡VALUE REPRE j| SENTATION, =i 


ER 


' «ы b m «ә ср b ер ев чь @ o 
re t reoresents the tyoe of tne value: 
single value 
range values 


whe 
t=0 
21 
tz2* multiple values 


$8 98 66 


2 is used as delimiter. 


Usage of "*s**4" for value representation indicates that value 
is not known. 


ae ы 
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WORKSHEET FOR DESIGN PHASE ANO DESIGN REVIEW PHASE OF PROJECT 5 4 


' МАМ * } 
IHOURS!ERPOR! COMMENT 
MES/STEP! # | 


ӘТЕР 


' i 
PROBLEM ANO PLANNEO SOLUTION $i ALTERNATE 10 
# ' 'T 


V SOLUTIONS 


> 
= 


ж «о «ер "D Gm "D 4D 4D «о «о «о D qp CD UD D 4D <р «о «ғ «о «о D CD UD UD s «о «ғ GP "Db 4D 4D "DP чь ..s. qu o <... GP po "DP "p 4D Gb "US 4b "D ЧР DD em «жы «в «е D UD DP UD em D р cp р "Po a» ею «ы oP o e o 


3 !a) Define utilities for input 
‘of data base information: 
‘oP ILL,EXTRACT,GETCHAR,SKIP 
I=GET OLD FILE INFORMATION 
!'=STORE,CLEARIN,CLEAROUT 
!-CAROIN, PRINTOUT 
!=TYPIN,TYPOUT 
(FILE I O TERMINAL IQ 
! «GET ATTRIBUTES AND VALUES 
I=GET ATTRIBUTE,GET VALUE 
‘=F INO ATTRIBUTE 
ib) other utilities: 
ı=SPACE,ERROR,DIAGNOSTICS 
-INITIALIZE ALL 
4 la) Define command capabilities 
i"List al! attributes (LISTA) 
¡“List all memoers (using only 
(ione attribute value oair 
ichosen by user) (LISTALL) 
("List all members (printina 
1211 attribute value pairs of 
teach member (LISTOBASE) 
i"List all available commands 
ШСЕТ5ТС) 
("List all attribute value 
ipairs of a sinale member 
I (LISTM) 
("Select a single member for 
¡retrieval of particular values 
¡Of interest (CONTROL) 
¡“List a particular attribute 
'value pair of member in con- 
‘trol (FA,ATIR) 
(“Find 211 сага base members 
¡which with given conditions 
¦ (FINO, FINO 10) 
("Switch output from terminal 
ito file and vice versa(SWITCH) 
("Change key attribute (KEY) 
i*Obtain diagnostics (0) 
¡“Super user mode (SU) 
tb) All subroutines which han- 
idle commands are nameg accore 
ingly. 
Remarks: The last two functions are not required, however, they can b 
effectively used for testing purposes. They also supcort further 
extensions of the program. 


— E 
LS, 
Ф fly 
C e 


те zz 22 za zz sm za 00 2a Sm ma 2. a ay a 4 ¿4 AA AAA AA 4+ ==з =ч» mm ma mn Sa Sa «=з 45 ma ad me nn an a ne nn mn an an nn ne me 
m a za ma 20 zo zo on oo ma wea == «зе» mo nm mo 2a nm Sa mm ma ma mu ma Sn ma sm mm ma mm Әәә Фә ӘӘ ғ. Sa fa 2. o. na za sm za zn mm om 
20 2... 2... 215 2020 2. a 020 20 ғ. 0m zo ma da za sa za DE Sn ma 2 man Da nm tn du me an ma nn me ma mn mo ma Sa 4D nn aa 4 .. 


(b == sw so as ao m 21. ma mu za zz zz ma zz m zz mm Sa Sa se ma m o ч 20 2% 22 2 mm me an ҹә сә чә Ҹә Ҹә чә ә Ҹә чә ҹә ma Da nn b mm o cea 
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WORKSHEET FOR DESIGN PHASE AND DESIGN REVIEA PHASE 


STEP 
# 


PROBLEM AND PLANNEO SOLUTION 


ALTERNATE 
SOLUTIONS 


5 


¡Analysis of implementing FIND 
¿(FIND ID) function. 
ıDefiniton of subroutines: 

! -GET CONOITIONS 

'-СЕТ REQUEST 

1-СЕТ QVALUE (functions which 
tallow user to define aueries) 
ı=TEST CONDITIONS (evaluation 
ı of Queries) 

¡Define functions to test 
isingle discrete values: 
ter INDATTRIBUTE 

FeC QUAL, MATCHING 

°F IND MEMBER 

¡Define functions to print re» 
ШЕШІ 65: 

}: “ИК [ТЕ RESULTS 
PeLISTATTRIBUTE (Value) 

nA] 
idefined conditions are first 
stored within à linked list. 
¡The result of all 
lare printed after all! data 
¡members have deen examined. 


‚Design of retrieval functions 
¡for multiple values and range 
! values? 

| COMPARE MANY 
ı=LLIMIT,ULIMIT 

ı (return upoer and 


¡Design review and imolementa- 
ition of improvements. 


for 


lower limit) 


menvders which satisfy user 


comparısions 
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ANC OUTPUT FROM ANC TO FILES; 
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WORKSHEET FOR CODING PHASE OF PROJECT # 3: 4 
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94/27/2030 


05/02/1100 


ЕМО 
DAY/TIME 


98/25/2200 


04/26/1630 


94/27/2100 


05/02/1200 


= 


PROGRAM PART 


Punchina carcs 


‚Coding of 
‘debugging aids 
апа punching 
¡cards 


¡Changes ассог- 
¡ding to gesign 
¡review 


¿Coding of new 
¡procedures to 
‚handle range 


¿Value comparison 


tand punching 
‚cards 


1) 


+ 


35 
36 


48 


256 


<. ao so Dee 4» so so so va $. Фә Фә ФӘ аә Чо е» =з =» шуй San nn na aa aa eo 


ERROR:DAY 
quta 


2100 
2200 


2050 


4 


ı COMMENT 
! 
' 
' 


1) Record „hen error is 
detectea. 


A1 
A1 


Gly 


Change due to error 4 50. 


! 
! 
! 
! 
0 
' 
' 
4 
' 
1 
' 
t 
1 
1 
! 
+ 
! 
! 
1 
! 
1 
' 
1 
! 
1 
' 
' 
' 
' 
' 
! 
! 
' 
V 
0 
' 
} 
t 
t 
t 
! 
! 
! 
! 





АММЕХ 0 Page 1 of 10 
WORKSHEET FOR DEBUGGING PHASE 
PROJECT #2 3: 4 DEBUG Run # : 1 
Begin of Debug Run (day/time) : 04/20/2330 
End of Debug Run (day/time) : 04/21/2030 
8 of Debug Steos incl. іп Debug Run: 4 CPU time for Debug run (sec): 0.0 
CPU time for necessary compiles (sec) : 19,39 
a) 3.93 b) 4.42 CIS 02 5.70 е) f) о) 
Man hours for this Debug Run : 2.5 (including preparation of debug run) 
МАМ 1) 
STEP'!PROGRAM! OBJECTIVE AND EXPECTED ! ACTUAL ! DAY!IHOURS!ERROR! COMMENTS 
я! PART ! RESULT t RESULT ITIMES7STEP! z !" AND CODED 
' ' ' ' H ! ERROR TYPES 
' i ' ' : ' 11) Record when 
' ' ' 14/20! ' i error 
' ' ' „2550! 1„0 | ' occurs 
1 'Primi= ! Get error free comoile С сотоі1е! 4/21! : I 
tives | errors $1030! ' 1 Cé 
ı and ' ' ' ' СУЖА] 
'utili- | ‘ i : ПАЗ ES cH PA 
(ties i ' 14/21! jd c AM 
' ' ' ‚1100! IO NAT 
! 0 [] ü t 1 ! 
' ' ' ' ' 0 ! 
2 {Primie | Get error free compile ‘1 comoile!4/21! ' ' 
'tives, } jerror peso, 0.5! ' 
'utili- ! ' ' ' ' 
(ties: ' ' 41900! LOU Tte 
input ' ' ' ' ' ' 
Гіпес- | ' 14/21; ' ' 
tions i ' 11930} ' ' 
' ' ' ' i i ! 
B i | repeat step 2 !l comoile!4/21! | ' 
' ' 'error 19301) 0. ! { 
' 4 12000! Ze ae be 
' ' i ¡4/21! ' ' 
; ' ' ¡20001 ' ' 
0 | ! ! “ ' 1 
0 0 ! ! 0 1 ' 
4 | | repeat steo 2 ' ОЕК 14/21! : : 
' ' ' (20901 0.5 | ' 
' i ' 44/21) ' ' 
i ; ' 12030 ! ! 
' ' i ' i ' н 


сз] 





АММЕХ 0 Page 2 of 10 


WORKSHEET FOR DEBUGGING PHASE 
PROJECT 8 : 4 DEBUG Run # : 2 
Begin of Debug Run (day/time) : 04/21/2130 
End of Debua Run (day/time) : 04/22/1830 | 
# of Debug Steps incl. in Debug Run: 6 CPU time for Debug run (see): 14,85 
CPU time for necessary compiles (sec) : 39.55 
a) 5.48 Б) 5.52 СЕ)” 3.58 a) 4.47 е) 8.25 #) 9.14 5) 


Man hours for this Depug Run : 5.5 (including preparation of decuo run) 
MAN 1) 


STEP!PROGRAM! OBJECTIVE AND EXPECTED | ACTUAL í DAYIHOURSIERRORI COMMENTS 
Br: PART | RESULT ' RESUME IS Er, 2 ıı AND CODED 
! ' ! ERROR TYPES 
' i ; ' ' ' 11) Record «hen 
wall | Get error free compile 12 сотоі1е! 4/21! ' ' error 
¡except i| ¡errors бгз 2 06D: i j occurs 
Iretrie-; ‚2130: (SO ЕР 
! val ' ' ' ' ! 10 м 
Ifunct=- | 14/21! ' ' 
i ions : i „соо! ' ' 
oe + repeat steo 1 and check ¦1 ргодгат! 4/21! i ' 
i | iIimitialization ‘error 2200 0,5 | 
i i ' 2200. Е ОР 
' ' ' 14/21! ' ' 
: ' ' 2230, ' ; 
B ! repeat step 2 15 ргосгам! 4/21! ' i 
' ' terrors пе 2.5 0 
' ' ' 14/22! ' ' 
н ' ' ‚1000 та (C28 
' ' ' 10201 ISE CDI 
i ' ' 11030; A eet 
' ' ' | 11901 usos cos 
i i ' ITO, 4 16 (012 
: ' ' 14/22! ' ' 
' ' ; 1200} ' ' 
4 14411 ! Get error free compile '2 comoile!4/22! ' ' 
¡except ; (including commana errors 212901709 5 3 ' 
ıretrie=-\ functions) ' 11200; LI GG 
¡val ' ' 11230) LST CIT 
ffunct= } DEAF ! І 
rions ' ' 1230: ' ' 
= WE; | repeat step Y ama check |2 ргодгат! 4/22! ; : 
: | initialization ‚errors ‚1400, 1.0 | : 
' ' ' 11450! eo Le 
' ' ' 14/22! ' ' 
' ' i $1500! | 20 Ca? 
Se |} | repeat step 5 a Oe Kix 4/22! i ' 
' ' ' £1800 0.5 3 


E 





АММЕХ 0 


NORKSHEET FOR DEBUGGING PHASE 


PROJECT 8 : 49 DEBUG Run 8: 3 


Page 3 of 


10 


Begin of Debug Run (day/time) : 04/22/1830 
End of Debug Run (day/time) : 04/22/2200 
# of Debug Steps incl. in Debug Run: 2 CPU time for Debug run (sec): 11.93 
CPU time for necessary compiles (sec) : 17.75 
A 3.71 b) 9,04 с) а) e) f) 9) 
Man hours for this Debug Run : 2.5 (including preparation of debug run) 
MAN 1) 
STEP'!PROGRAM! OBJECTIVE AND EXPECTED | ACTUAL | DAY! HOURS!ERROR! COMMENTS 
ET! PART ! RESULT re RESULT TIMES STEP. E | ano CODED 
' ! ' i ' ! ERROR TYPES 
' - ' ' ' ' .1) Record when 
' i І ' s ! ' error 
' À ' i ' ' ' occurs 
1 (AT! ! Get error free comcile 13 сотоі1е! 4/20! : i 
fexceot i lerrors (19301 0.5 | ' , 
ifuncte | ' ‚1945; ie ‚ А] 
Itions | ' 11950! 22 AS 
(0 сот”! ' 51595 ! баз ICES 
¡pare i ' ' i ' ' 
irange | ' ' ' ' ' 
‘values } ' H ' i ' 
'or mul=! ' ' J i - 
‘ticle | ' ' ' - i 
idis- i ' ' ' ' ! 
ісгете | i 14/22! 4 ' 
(values |! ; 12000! ! ! 
4 ' ' ' ' ' ' 
' ' 0 4 4 ' $ 
CE | repeat steo | and examinei 14/22! ' i 
' (| storage of data base in” | 0,К, ¡20005 I у 
' formation ' ' ' - 
' iCall attributes and values! ' i ! 
' ‚should be inolemented 4 4/22! ! : 
i ‘according to cesign) | 120200! i - 


- 259 - 





АММЕХ 0 Page 4 of 10 
WORKSHEET FOR DEBUGGING PHASE 
PROJECT 2 : Y DEGUG Run £ : Y 
Begin of Debug Run (day/time) : 04/22/2200 
End of Debug Run (day/time) : 04/25/1100 
4 of Debug Steps incl. in Debug Run: 6 CPU time for Debug run (sec): 45,47 
CPU time for necessary compiles (sec) : 73.14 
ЕШ 11.26 b) 9.73 c) 9.84 d) 9,96 =) 10.87 4) 10.469 а) 10.89 
Man hours for this Debug Run 3 7,5 (including oreparation of debug run) 
MÁN 1) 
STEP;PROGRAM; OBJECTIVE AND EXPECTED ¡ ACTUAL {| DAY!IHOURSS ERROR: COMMENTS 
2 1 PART } | RESULT ¦ RESULT ІТІМЕ!/5ТЕР! = ¢ ANO CODED 
' ! t ' ' ! ERROR TYPES 
' ' t i ' ' 11) Record when 
1 A) ¦ Check basic functions ı! programı 3/22; I ; error 
¡exceot | (exceot FINU function) ¡error 2200, 055; | occurs 
ıcompa* ı 10200! ı 24 1012 
rison | ' ' ' ' ' 
fof mul-! ' ' ' ' ' 
;tiple | ' І ' ' i 
¡values | ' ' ' ' ' 
sor ' ' ' ' ' ' 
‘range |! ' 11/22! ' ' 
ıvalues | ' 10230! i ' 
p | repeat step 1 11 огоагат!4/22! ' ' 
' ' ‚error 2250! 53.0, | 
' ' н 4/25; н ' 
' ' i 512503 1025 ОЗ 
% | ! repeat step 1 ‚1 program: 4/23} ' ' 
À ' lerror 12507 1.0; ' 
' ' ' 11300! CODOS 
' ' ' 14/23: i ' 
' ' ' 11330; ' ' 
4 | | repeat steo ] i1 orogramı 4/23! J i 
' ' ‘error 15501 1.0 | 1 
' 1400 ! 12217 DIS 
' ' ' 14/23! ' ' 
' ' ' 11430! ' ' 
a | repeat step 1 ¡2 program:4/23; i - 
' ' errors 11450; 1.0 ! ' 
' ' ' 11500! ‚ 28 idle 
' ' i 11500; нах 
' ' ' | 07951 i ' 
І ' i ‚159301 ' ' 
б | ‚ repeat steo | О.К. 19/24; i : 
' ' ' Оо ICON, ' 
' ' ' 14/25! ' ' 
' ' ' EO ' ' 


260 
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NORKSHEET FOR DEBUGGING PHASE 
PROJECT # : 4 DEBUG Run # : 5 
Begin of Debug Run (day/time) : 04/25/1630 
End of Debug Run (day/time) : 04/25/2400 
# of Debug Steps incl. іп Debug Run: 5 CPU time for Debug run (sec): 8,95 


CPU time for necessary comoiles (sec) : 51.3 


a) 11.02 6) 11.48 С) 11:90 gu T е) 7.55 f) о) 
Man hours for this Debug Run 2 5,5 (includina preparation of debug run) 
MAN 1) 
STEPI PROGRAM; OBJECTIVE AND EXPECTED 1 ACTUAL ! DAY!HOURSJERROR! COMMENTS 
= ! PART | RESULT ¦ RESULT !TIME!/STEP} # + ANO CODED 
' : ' ! j ' ERROR TYPES 
' ' ' ' ' і 11) Recora «nen 
IT Find (ССР СОКЕ МО function for 13 programıu/25, ' ' error 
‘funct> | trivial cases ¡errors О.о" ! occurs 
ıtion ¡ Check inout of conditionsi 11807; ¦ 30 154 
((sinalei (0-4 conditions should oe! 11700; ima 
0165” ı stacked according to ' 117501 і 52 1012 
Crete ¦ design) i 14/25! : ' 
(values)! : I750! 
4 ' 0 0 ! ' ! 
! 0 ! a 0 ( ! 
Шо! ; repeat step 1 11 programs 4/25} ' 
; | (usinq trace) ¡error ГТО, 2207 ' 
' ' ' 120301 1.353 4184 (Error 232 
i | 14/25) ' inot corrected 
' ' ' 12030: iproperly) 
a ( ( ( ( ! I 
; ( ! I ' ! ' 
B | | repeat step 1 il orogramı 4/25} i ' 
' ' error 20501 0.5 | ' 
' ' ' 12100! 504 E28 
' ' ' ES ' ' 
' ' ' 12100) ' ' 
' ! ! ! 0 ! 0 
I 0 ! ' 0 ! ( 
3 d ¡ repeat step 1 i| ргодгат: 4/25, ' 
' ' terror 12200! 0.5 ! | 
' ' ' 12250! ec E. 
' ' ' aves) ' ' 
' ' ' 10245! ' ' 
' ' ' ' ' ' ' 
B |! repeat step | а.к. Pages. ' ' 
' ' ' 12045) 1.5 1 ' 
' ' ' nudes ' i 
' ' ' 12400! ' ' 


zc 





АММЕХ 0 Page 6 of 10 


WORKSHEET FOR DEBUGGING PHASE 
PROJECT # : 4 DEBUG Run # : 6 
Begin of Debug Run (day/time) : 04/25/2400 
End of Debua Run (day/time) : 04/26/1930 
# of Debug Steps incl. in Debug Run: 7 CPU time for Debug run (sec): 10.25 


CPU time for necessary compiles (sec) ; 67.84 


a) 6.57 b) 12.88 с) 12.56 о) 6.56 e) 8:96 110.27 о) 9.84 
Man hours for this Debug Run : 8,0 (including preparation of debug run) ` 
MAN 1) 
STEPi PROGRAM!) OBJECTIVE AND EXPECTED ; ACTUAL ; DAYIHOURSIERRORI COMMENTS 
8! PART $ . RESULT ' RESULT ТІМЕ /5ТЕР; 2 ı AND CODED 
' ' ' ' ' ' ERROR TYPES 
' ' i ‘ i ' 11) Record «hen 
f 1411 I Get error free comoile 13 сотоі1е! 4/25! ' ' error 
s | and test FINO function ‚errors (2400, 2.0 | ' occuns 
' t for trivial cases ' (4/16! І ' 
' (all members listed must | 109001 ЕВ УА 
' | match conditions soeci- | ¡0910! ' 39 iA! 
| fied by input) ' 10915, ı 40 ¡Al 
H ' ' 14/26; ' 
' ' ' 1000; ! ! 
г { | repeat step 1 (2 рподгат! 4/26! ' ' 
' i lerrors '10001 2.0 ` ‘ 
' ' ' 10509! ı 41 1С28 
' ' ' 1100, i a2 сав 
' ' ' 14/26) ' ' 
' ' ' 112001 ' ' 
EE 4 | repeat step 1 11 program! 4/26; 1.0 | ' 
' ' ¡error 11330) ' 45 ¡Al 
' ' ' 14/26! ' ' 
' ' ' 11440] ' 
4! | repeat steo 1 il comoile: 4/26} ' ' 
i | (including devugging ıerror 1630 1.0 | 
; ; aids) ' 14/26! ' ' 
; ' ' 11150! ¡ 99 ¡Al 
' repeat step 4 il programi4/26! ' ' 
j ' lerror ШТАП 0,9 | ' 
' ' ' „1735, ı 45 {AS 
' ' ' 14/26) ' ' 
' ' ' ‚1.300, ' ' 
B 1 | repeat step Y 11 program¡4/26! : | 
' ' terror 115000025857 ' 
' ' ' ‚1615, ¦ 46 lAl 
' ' ‘ 14/26} ' ' 
' ' ' 1330) i ' 
Жо! ırepeat steo 4 ЖҮЗЕ m 14/264 ' ' 
' ' ' PISO EI i ‘ 


= = 





АММЕХ 0 Page 7 of 10 


WORKSHEET FOR DEBUGGING PHASE 
PROJECT 3 : 4 DEBUG Run 3 : 7 
Begin of Debug Run (day/time) : 04/26/2000 
End of Debug Run (day/time) : 04/26/2300 
2 of Debug Steps incl. in Debug Run: 2 CPU time for Oebug run (sec): 7.0 
CPU time for necessary comoiles (sec) : 18.14 
a) 9.75 b) 8.41 с) a) e) f) а) 
Man hours for this Üebuao Run : 3.0 (including preparation of debug run) 
STEP¡PROGRAM; OBJECTIVE ANO EXPECTED ACTUAL ros COMMENTS 


* | PART | RESULT ¦ ВЕЗУТ ПЕТЕР, 3 i AND CODED 
' ' ' ' IEERBON TYPES 


1) Record when 


è % 4 ! t % t 

1 ! ' I 4 % ! 

4 ' ‘ ' i ; ' error 

i ' I ' i i ' occurs 
1 ; A11 ¦ Test FINO function for :1 огоагат,4/25! ' i 

' I various inout (inclucing ;error 2000 e. Q0. ' 

' ı also extreme conditions) | ‚2120, ‚ G7 C28 

' ! (al! aueries should be - н : - t 

i ! answered accordina i 14/26; ' ' 

н ¦ design) 10200! ! 

! ' ' ' ' ' t 

4 ! ! y ! % ! 
E 1 |! repeat steo 1! WOKS 14/26; ' , 

' ' ' ео 0r i 

' ' i 14/26! ; 

! ! ' ' 4 

! % ! I è 

! ! t ! | 

' % % 1 ! 


12300; 


= on 
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WORKSHEET FOR DEBUGGING PHASE 
PROJECT a 3: 4 DEBUG Run # : 8 
Begin of Debug Run (day/time) : 04/27/1500 
End of Debug Run (day/time) : 04/27/1900 
4 of Debug Steps incl. in Debug Run: | CPU timer for Debug run (sec): 11.98 


CPU time for necessary compiles (sec) : 10.02 


а) 10.02 b) c) о) e) ғ) 9) 
Man hours for this Üeouao Run : 3.0 (including preparation of debuc run) 
MAN 10) 
STEP!PROGRAM! OBJECTIVE AND EXPECTED | ACTUAL | DAY HOURS ERROR! COMMENTS 
mt PART t RESULT 4 RESULT TIME SIER! 5 ANB CODED 
EN o: | ERROR РЕ 5 
' ' ' ' I ' 11) Record «hen 
; ' н i - i ' error 
' ' ' ' H ' ' occurs 
1 (A11 | Repeat Debua Run 37 underi О.К. аат. ; ' 
' ! CP /CMS ' ЛЕЛ! 3.0 | ' 
' ı (same results expected) | ‚0/27; ' ' 
' ' i 1900! ' i 


- 264 - 





АММЕХ 0 


PROJECT я : 4 


Page 9 of 10 


WORKSHEET FOR OEBUGGING PHASE 


DEBUG Run # : 9 


Begin of Debug Run (day/time) : 04/28/1400 


End of Debug Run (day/time) : 04/28/1600 


8 of Debug Steps incl. in Debug Run: I CPU time for Debug run (sec): 19.58 


CPU time for necessary сото11ев (sec) : 9.46 


Man hours for 


a) 9.46 о) c) о) e) f ) а) 
this Debug Pun : 10.0 (including oreoaration of debug run) 
MAN 1) 
STEP¡PROGRAM; OBJECTIVE AND EXPECTED ACTUAL РАТУНОУВЬ  ЕКВОВ: COMMENTS 
Ж! PART | RESULT ' RESULT I!TIME /STEPI 3 ( AND CODED 
4 t 0 4 ! 1 
1 All 


ee me A Ao a. dp db o za aa am an Tan nn az ma op za du mn Sn az oe vo Sa ah mo om zo zo ze ma aan zo o =» 


ERROR TYPES 


1) Record when 
error 
occurs 

4/28 

1400 


Various tests under 
CPCCA: 

“Test initialization 

-Test LISTA (list of all 
attributes ) 

“Test LISTC (list all 
available commands) 

“Test LIST™ (check for 
all memoers and illegal 
input) 

«Check program for input 
of undefined commands 

“Test CONTROL (check for 
illegal input also) 

“Test functions FA anc 
ATIR for several members 
in control 

“Test SwlTCH (examine out- 
out file) 

«Test KEY (change of «еу 
attribute as desired by 
user) 

“Test LISTOBASE (all meme 
беге аге listed with all 
all attribute value 
pairs) 

“Test LISTALL (memoers are 
listed only by key attri- 
cute) 

“Test FIND function (using 
various input combi- 
nations) 


Q 
e 
A 
. 


n^ 
о о 


ee =e zo oo zo zo zo ad za so De vu mu «ка» 2. mn ma nu dm >. o 2. 2. en. we «ач» «рса mo mdo mu nn nn mn nn nn 


+. we ча on on $0 =з =з Чч 40 ge. == ou od zo za Sy zo so чч «ач. 4D 4D a. o o $6. me va nm 


— £ 
о м 


Seo = 
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NORKSHEET FOR DEBUGGING PHASE 
PROJECT £ : 4 DEBUG Run 8 : 10 
Begin of Debug Run (day/time) : 04/28/1600 
‚End of Debug Run (aay/time) : 04/28/1800 
% of Debug Steps incl. in Debug Run: 1 CPU time for Debug run (sec): 12.08 
CPU time for necessary combiles (sec) : 9.46 
a) 9.46 b) c) а) е) 15 3) 


Man hours for this Debug Run : 2.0 (including preparation of debua run) 
МАМ 1) 
SIEP PROGRAM] OBJECTIVE AND EXPECTED, ACTUAL | OAY!HQURS!ERROR! COMMENTS 
NECS PART ! К СШ] RESULT ҮТІМЕ;/5ТЕР! > AND CODED 
' | ERROR TYPES 
1) Record when 
arror 


occurs 


Various tests under 

CP/CMS3 

a) Test SU (super user 
function) 


1 proaram 


error 49 


С27 
b) Test FIND function 

for 0 conditions (al! 
members should oce listed) 


c) Test FIND ama FIND ID 
using 1-4 different cone- 
ditions (check соггес+- 

ness of orogram especially 

multiple values and range 
values) 


d) Test KEY function for 
illegal inputs (ocroaram 
Should Provide an aooro- 
priate error message) 


4/28, 
1830; 


ee dc y b "o o wa "re o $ ec ¿DD "m "D DS A аә 7^ we we ow e ee AA PA X mn 
< nme mo 2 ga md za ma AA ӘӘ Әә ә ФӘ ao a A Da DA AO ee Da da ma na ma vn ma am 
m zz. mo ¿DO A A DA De Ds e e AA DA DIS ӘӘ Әә ee eet we we we "A m o o o 
fae gm Em was aw Ds DR a AA AA soe ao a DA DA DA 0 DA DA Әә e nn ma wes owes aa 


eae ma mo DAD Dom aa aa es see os a ao OS ae ae u as COS ae as a e ae o oo om 
en mua mo 20% 20 saa sas eo so Sa ЧА» 4b 4D nam ve nn gan DA AA eo a dedo a= ee ae oe ea 
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АММЕХ Е1 Page 1 of 2 


ERROR LISTING 
PROJECT 2 : 4 
Begin of Project (day/time) : 04/19/1400 
End of Project (day/time) : 04/03/1800 


Man hours for total project ? 101.0 


ERROR: PHASE { PHASE | ERROR ' ШІМЕ | # of OTHER 

# | im which: in which, TYPE ıspent to ! STATEMENTS OR 

' ERROR наз: ЕЯКОК was! (see ANNEX F) са ven thaq PARTS OF THE 

dis- 1 "ade | ! ERROR : PROGRAM 
! Covered | ' ı (Man ' AFFECTED 

' i н ; min.) | 
1 ¡Debugging: Coding ! С5 ' B ' 
2 Debugging! Coding ! 81 i 5 ' 
3 Debugging! Coding ı Al ' 5 ' 
4 Debugging! Coding т А] | 5 I 
5 Debugging! Coding ! Al н S 4 
Coding ; Coding | C9 ' S | 
7 :Debugging: Coding ! С17 i 5 ' 
8 Denuaging! Coding ! СІ2 ; $ ' 
9 iDebugging:i Coding : C7 | 5 ; 
10 Debugging! Coding ! Al t 5 ! 
11 ¡Debugaing; Desian BT i 5 i 
12 ıDebugaing; Coding ; C28 : 5 ' 
fem, Debugging: Coding ! С21 i 15 і 
14 !Debugging! Coding ! C21 j 15 ' 
15 ¡Debuggina; Coding ! C28 ' 10 н 
16 Debugging! Design ! 012 i 25 4 
17 ıDebugging: Coding ! СЫ 1 5 i 
18 Debugging! Coding ¦ C17 І 5 I 
19 iDebugaing: Desian ! 012 ' 30 н 
20 iDebuggingi Coaing ; Ce? l 10 ' 
21 ¡Debugging; Coding ı Al ' 5 
22 ¡Debugging; Coding ! 42 i 5 І 
23 iDebuaaingi Coding ! C23 ' 5 ' 
24 Debugging! Design | 012 : 10 I 
25 iDebuggingi Desion ! 03 : 15 i 
26 Debugging! Desian ; D13 ' 30 | 
27 ;Debugging: Design ! 015 i 20 1 
28 Debugging! Design | D12 | 30 - 
29 Debugging! Coding ! C27 i 5 I 
30 {Debugging}! Coding ! Al : 5 : 


- 267 - 
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ERROR LISTING 
PROJECT # : 4 
Begin of Project (day/time) : 04/19/1400 
End of Project (day/time) : 04/03/1800 


Man hours for total project : 101.0 


ERROR! PHASE } PHASE i ERROR : TIME : # of OTHER 
8 | in which; in which: TYPE «spent to ıı STATEMENTS OR 
¡ERROR wasiERROR was! (see ANNEX F) !solve tne! PARTS OF THE 
' dis- | made | I ERROR i PROGRAM 
! Covered | ' ı (Man AFFECTED 
' ' ' - mima) | 
31 i0eougaing: Coding ! С27 i 10 ' 
32 iDebuoging: Desion i 012 : 90 - 
33 ¡DevuagingiDebugainmg; 84 15 
34 iDebugaing: Coaing i C28 : [5 : 
Meme coding +. Coding i: Al ' 5 ' 
Coding ^ Coding ) А1 i 5 I 
37 ¡DebuggingiDebugaing; Al : 5 ' 
38 iDebugcingi Coding $ Al 1 5 1 
39 iDebuggingi Coding | AI І 5 i 
40 iDebuggingi Coding ; Al ' 5 ' 
41 }Debugaing; Coding ! C28 i S i 
42 ;Debugging; Coding | C28 ! 5 1 
43 ¡Debugginma; Coding 1 А1 4 5 i 
44 ‘Debugging! Coding | Al 5 ' 
45 ;Ü0ebpugainaiDecugging! 43 } 5 ' 
46 Debugging! Coding |! Al : 10 ' 
47 Debugging! Coding ! C28 I 10 | 
SS ESOS i Coding › С17 і 5 : 
49 iDebugging: Coding ! C27 ' 30 : 
50 | Testing | Design ! 03 i 120 ! 


= 268 - 





АММЕХ Е2 
ERROR: DAY | 
oe) TIME! 
' i 
' ' 
104/21! 
ІШ! 1020) 
2 1! 1030; 
ШІ 1010! 
ШЕ! 1010! 
ee, 1030; 
om, 1950; 
КЕ 1900! 
8 ! 2000! 
ШЕ? 2130) 
ШЕ 2150! 
ШІ. 2200! 
104/22! 
E 1000: 
je, 1020: 
14 ! 1030! 
ES 1100! 
NO 1110; 
Wie, 1200! 
13 1230: 
91 14501 
2051. 1500; 
21 ! 1945: 
22 1 1950! 
e3 ! 1955; 
24 | 2200! 
194/23! 
ПОО, 1230! 
26 ; 1300! 
27 ¡ 1400; 
28 | 1500; 
E01. 15001 
08/25! 
30 ( 1630; 


Page 1 of e 


ERROR LISTING (COMMENTS) 


COMMENTS 

(EVIDENCE, THOUGHTS, WHY WAS THE ERROR 
WHY AND HOW WAS THE ERROR DISCOVERED? 
ERROR BLOCKING, etc.) 


MADE? 


Errors 21 thru 5 are due to influence of fatigue. 


Found while checking previously written code durinc 
ounching of cards. 

Different variaole name assumed. 

Missing mandatory declaration. 


Errors 814 thru 16 are aue to insufficient desx checking. 


Upper case key presseg while ounching caras. 
Usage of "THEN" instead of "DO".(wrong format) 
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АММЕХ Е2 

ERROR! DAY | 
ES TIME! 
' ' 
i ' 
"04/25! 
ШІ! 17001 
32 ) 1730! 
ЕЗ ( 2030; 
' 0 
34 | 2100; 
ES 2100! 
26 ! 2200! 
37 ! 2230) 
"04/26! 
38 |! 0900; 
39 ! 0910! 
2051. 09151! 
2:055 1050: 
40 ! 1100! 
4% ; 1550; 
44 | 17301 
poe. 1745: 
5 1815! 
47 1 2120! 
' i 
' ' 
04/27! 
ШЕ” 2050! 
10928: 
49 | 1620! 
2057011 
poe, 17001 

' 


Page 2 of 2 


ERROR LISTING (COMMENTS) 


COMMENTS 

(EVIDENCE, THOUGHTS, wHY WAS THE ERROR MADE? 
WHY ANO HOW WAS THE ERROR DISCOVERED? 

ERROR BLOCKING, etc.) 


No oroper desk checking. (Error could have been 
avoided by desx checking.) 
Inacorooriate correction of error 832. 
results were not interoreted correctly. 
Forgotten "*1". 

Errors 235 and 36 are due to fatigue.(trivial 


Debugging 


errors) 


Errors £38 thru 40 are due to lack of concentration 


while punching cards. 


Double negation in connection «ith logical ANO 
could have oeen testec by usage of a trutn taole. 
The error could have been avoided this way during 
a desk test. 


Found while punching cards. 


It was surprising to the experiment Programmer 

that using the EBCDIC character set the 

following comparison will be evaluated "TRUE": 
т = n » n * n 


E£rror 3 50 was made because this relationsnio 
was not known. 
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ANNEX F FINAL STATISTICS 


PROJECT 3 4 


FINAL STATISTICS 
Project name : DATA RETRIEVAL SYSTEM 


Short description: 

The program is designed for usage under CP/CNS, It 
expects an inout file labeled "DBASE INPUT" to contain data 
base ¡information in a particular format such that t^e oro- 
gram can read all information апа store it into memory. 
After all data base members are defined Dy incut ana imple- 
mented within linked lists the user тау operate upon the 
data base using functions from a previously aefinea set of 
functions. 

The corogram has been designed and implemented in such a 
manner that it will oe easy to imolement rore functicns or 
to extent the currently defined limits of the сгосгат. 


Quantitative measures! 
1. Я of source statements : 1084 
2. Total man hours for oroject : 101.9 


3. Man hours scent in 


a) Design 24,0 

5) Codina : 24.5 

c) Deougging : 41.5 

9) Testing : 11.0 
4. CPU time for compiles: 343.57 sec. 
Эз CPU tipe for debug runs: 1360,05 sec. 
6. CPU time for test runs: 38.04 sec. 
7. # of test and debug runs: 13 
8. 4 of test and debug steos: 43 


9. 4 of errors found: SO 


10. Total man hours used to correct errors: 11.25 


sx. 





АММЕХ Е FINAL STATISTICS 


11. Error Detection: 


Mean time between error detections: 87.7 man min. 


# of 
errors ы 
t 
$ 
% 
35 | 
! 
' 
' 
% 
' 
і 
0 
30 ¦ 
0 
L| 
% 
$ 
жж 
и ж 
25 j * 
я 
я 
I ж 
ца 
20 j + 
ж 
я 
Ш а 
! z 
ПЭ | а 
ж 
па 
ж 
Т. 
ПО i * 
E 
ү k 
1 # 
! жу) 
6 ! ха жая 
га яяя я 
| k z x tkk 
1 & © KF k жж» 
1 | x x kk x kx ж k keke Rx ххх man hours 
w + + э +ф = + - + “= + = фо фео фо фео фо фо фео фо фо фо фо фо фо фо фео +$ % + % + = $ = + % + = + % + = = > о” 
1 e 3 4 5 © 7 3 9 10 11 12 13 project time 


TIME BETWEEN ERROR DETECTIONS 
(measured from point im time of detection of previous error) 
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ANNEX F FINAL STATISTICS 


12. Error Correction: 


Mean time to correct an error: 13.3 man min. 


# of 
Errors 
corrected. 
t 
' 
* 
30» ж 
! * 
i E 
i * 
! * 
eS: * 
i * 
i * 
í ^ 
: * 
201 * 
: > 
F x 
: * 
' * 
151 * 
| ж 
i * 
| * 
! * 
101 * 
I ж 
| * 
i ж 
' * * 
E E * * 
а ж % ж ж 
4 % * * * 
I * * * * 
i * * ж * * * * * 
-%----%----)----)----%----%----%-----,,,-%-..,----%--...----%--> 
1 5 10 15 20 25 30 90 120 180 


man minutes 
of project time 
TIME TO CORRECT ERRORS 
(measured from point in time of detection) 


cu Ser 





ANNEX F 


13% 


f) 


14. 
а) 
о) 


а) 
е) 


f) 


When 


un.) va 


о? 
о} 
of 
of 
of 


of 


of 
of 
of 
of 
of 


of 


errors 


errors 
errors 
errors 
errors 
errors 


errors 


errors 


errors 
errors 
errors 
errors 
errors 


errors 


меге 


found 
found 
found 
found 
found 


foung 


were 


made 
made 
made 
made 
"ade 


таде 


founa: 


during 
during 
during 
during 
during 


during testing: 


made: 


during 
during 
during 
during 
during 


design ohase: 
design review: 
coding: 
debugging: 
writing of 
test procedures: 


desan chase: 
design review: 


coding: 


Geouagina: 
writing of 
test procedures; 

gurina testing: 
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ANNEX F FINSE STATISTICS 


ES. TIME HISTORY GRAPHS : 


в о” 
Errons 
T 
' 
: Erron Types: 
| A: Clerical error 
i 8: Debugging error 
! C: Coding error 
' 0: Design error 
5» А 
' А E A 
' À OCC ESTO A AA 
! А CACCC А. 0С С С AG А 
16; C  CCCCOD A40 DD АОВААСАА С СС О 
¿opor opor yo or parar pr o or pr rr pr rr oros rro por a porros oy man 
2 20 40 50 80 100 hours 
NUMBER OF ERRORS FOUND VS PROJECT TIME 
2 of 
Errors 
Т 
: 
10» 
' 
' 
' 
5» x 
| x * 
А * *ot * * * * * к * 
4 * жжжя ж “ж URN ж 
|! x **X** kk кя RERRARA RR ж жж ж 
+=+=ф#=+} =} = +{ =} =} = +} = +} =} =} = {о} — +} = {= фео фео фео +} =} =} = +} = +{ = фо фо роф оф о Ф е آں>‎ тат 


2 20 40 50 80 100 hours 


NUMBER OF ERRORS CORRECTED VS PROJECT TIME 
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ANNEX F 


1. 


2. 


ERROR CATEGORIES AND TYPES 


Design Errors 


The follwing types of errors aoply to both categories 
"System Design Errors" and "Program Design Errors": 


Codi 


O 
un 
е! Фо еб 406 8 зо ©6 od Фо 


Communication Error 

Design Neglicence 

Forgotten Cases or Steps 
Timing Problems 

Errors in 1/0 Concepts 

Data Design Error 
Initialization Error 
Inadeauate Checking 

Extreme Conditions Neglectes 
Seauencing Error 

Indexing Error 

Looe Control Errors 

Misuse of Boolean Expression 
Mathematical Error 
Reoresentation Error 
Misunderstanding of Problem Specifications 
Other Design Errors 


ng Errors 


о 
ut 
Фо 0600. oG 40 ое 6% во oo 


Misunderstanaing of Design 
Negliqence 

1/0 Format Error 

“Misplaced Data Declaration 
Multiple Data Declarations 
Missing Data Declaration 
Inadequate Data 

Initialization Error 

Error in Parameter Passing 
Inadequate or Forgotten Checking 
Level Problems 

Missing Declarations of Block Limits 
Case selection error 

GO TO Problems 

Comment Error 

Forgotten Delimiter 

Inconsistency in Naming 

"rong Use of Nested IF Statements 
Indexing Error 

Inconsistent Use of Variables or Data 
Sequencing Error 

Flag Usage Problems 

Syntax Error 

Looo Control Error 

Incorrect Exit from Subroutines 
Language Usace Proolems 


cod iet 





ANNEX F 


E27: 
G26: 
529: 
220: 
єз: 


3. Clerical 


A1 
Ae 
A3 
А4 


эе 90 096 өө 


4. Debuagina 


81 
Be 


83 
Ba 
85 
Bo 


е. ев e. ее 


ERROR CATEGORIES AND TYPES 


Forgotten Statements 
Representation Error 
Control Seauence Error 
Incorrect Subroutine Usage 
Other Coding Errors 


Errors 


Manual Error 

Mental Error 
Procedural Errors 
Other Clerical Errors 


Errors 


Inacorooriate Use of Debugging Tools 
Insufficient or Inaooroorıate Selection 
of Test Cases or Test Data 
Misinterpretation of Depugaing Results 
Misinterpretation of Еггог Source 
Negligence 

Other Deouaaina Errors 


S. Testing Errors 


— 
(м 
60 ев өө oo оо 


Inadeauate Test Case(s) or Test Data 
Misinteroretation of Test Results 
Misinteroretation of Proaram Specification 
Negligence 

Qt^er Testing Errors 
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АММЕХ С Page | of 34 


DOIRECTED GRAPH REPRESENTATION 

PROJECT E < U 

Program part * CLEARIN, CLEAROUT, CARDIN, PRINTOUT, 
MINI PON LEE [70; TERMINAL 1/0, 
GET OLD FILE INFORMATION, w"ITE NE^ FILE 
INFORMATION, CARI, CAR2, CORI, CORA, 
5Е Т ЕР $ЕТСОЁ1!, SETCOR2, FREET, 
FPEE2, FIND ID, GETARVALUE, MAIN 


EONZLEXITT MEASURES: 


NUMBER OF STATEMENTS: 2 =- 9 


NUMBER CF ACCES: : 
: Ї 
V 


AMM 

оъ 
= х 
CHM 


1.cccooc 


NOTE: All 23 subroutines have the same structure. 


eo >= 





ANNEX G Pace 2 of 34 


DIRECTED GRAPH REPRESENTATION 
PROJECT = : 4 
Program oart : 4LLUCATE1, S5LLOCATE2, CONTROL 


COMPLEXITY MEASURES: ® 
NUMBER OF STATEMENTS: 8 = 9 
NUMBER CF NCCES: 4 
NUMBER CF ARCS 3 
NUMBER CF FATES: 2 
CYCLCMATIC КИМЕСЕ: V(C)= 1 © 
REACHABILITY CF NCCES: 
МЕСЕ 1: 1 
МЕСЕ DE. l 
Mme Ce e 1 
NG CE á 1 
SUM: 2.СС0СС0 С 
REACFABILITY INDEX A 
CE CIRECTEC GRAPH er 2,009) 
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COMPLEXITY 


NUMBER 


NUMBER 
NUMBER 


>>”) 
Сить 
OGON Y 
mnmtnman ec 


í +A) 
MA 
v 
OO 
eT GC 
Dec 
mMm є 


АММЕХ 6 


PROJECT а 


РБгоагат саг" 


MEASURES! 
UF STATEMENTS: û 


122000039 


DIRECTED GRAPH oe oe wi ON 


d 


: SPACE 


Ф 
a 
e 
52 


cU = 


Page 3 of 


34 





АММЕХ С 


DIRECTED GR4PH SEPOQESENTATIUN 


PROJECT =>: 4 


еса ГЕТЕ, ГГ ТЕ 


COMECEXITY MEASURES: 
NUMBER OF STATEMENTS: 7 - 9 


NUMBER EF NCCES: 5 
NUNBER CF ARES : 5 
NUNBER CF FATES: 2 
ПӨРЕХАТІС NUMBER: У(Еіз 2 
EEGCFABILITY CF ACDES: 
ШЕШЕ [ws 1 
NCCE PEE 2 
NCCE 2. d 1 
ECS 4 : 2 
Nu tE 35 1 2 
EN SUM: 8.СССССС 
REACHABILITY INCEX _ 
Ер OlRECTecL CREPAR: 2221999 


aa 


Pane 


d 


of 





E 


ANNEX 


GRAPH REPRESENTATION 


DER Ee Ve © 


PROJECT 2 


OTAC TZE TALE 


Proqram part 


OGOGOOO0O0 


MEASURES: 


COMPLEXITY 


56 


NUMBER OF STATEMENTS: 


NECESE 


AY AO JUAN OO TT UY UD 


емге Y UN AA ou 


EABILITY СЕ 


(Quiuiiuiugujujujfugj 
ООО 
"JUO)U) (OUO OU) (2C) 
CC o EA AA 


ee 





N ғ” ? 
ANNEX f rage a cf od 


DIRECTED GRAPH EPOESENTATION 
PROTECT ==: 4 
Proaram oart E>RNAR 
COMPLEXITY MEASURES: 
NUMBER OF STATEMENTS: 24 © 
NUMBER CF ACCES: 6 
NUNBER CF ARCS : 5 
NUMBER CF FATHS: 4 
CYCLCMATIC NUMBER: V(G)= 1 © 
SEACFABILITY CF ACCES E 5 
NODE 1 ° 1 
МЕСЕ 2 : 1 
МЕСЕ = : i © 
КЕСЕ - : 1 
NETE 5 : 1 
NCCE é ¢ l 
SUM ERCECECER 
REZCEABILITY INCEX 
ШЕ CIRECTEC GRAPE Ее 0 


SB „ 





54 


Pace 7 of 


ANNEX G 


DIRECTED GRAPH REPRESENTATION 


4 


PROJECT 2 


DIAGNOSE 


Proaram part 


COMPLEXITY MEASURES 


83 


NUMBER OF STATEMENTS: 


IE 


ТЕ 


Є Sm 5 


LIE 


т < Z < < < Z < < Z Z Z Z Z Z = 


O 
о 
uy 
m 
е? 
т 
0 
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оза O 
Uv е 
uu tO 
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сес) 


LODOS E 
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ANNEX G 


ВЕБЕ СҮРЕ ME EE SSE AN LCR 


PROJECT ЛЗ 4 
Program oart БОП ТЕГЕН, isis, EISTC, 
ҒІЛО УАСПЕ LENGTH 
COMPLEXITY MEASURES: 
NUMRER OF STATEMENTS: 3 - 13 
NUBER CF NCCES: 5 
NUMBER CF ARCS < 5 
NUNBER CF PATHS: 2 Q 
CYCLCMATIC NUMBER V(G)= 2 = 
RESSPARBILITY CF NESES: 2 
Recs lo: 1 
No E Ze: г 
ШЕГЕ 2 1 
NOE E 4 2 2 
NG LE 5 2 
SUN: 8 СС0С00 
REACHARILITY INCEX ] 
СР QIRECTEC GnRAPF: 1.255595 
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Расе 


SIA EL 


à of 


5d 
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ANNEX G 


GRAPH REPRESENTAT ON 


DIRECTED 


PROJECT 2 


СЕТС АВ 


Program part 


MEASURES: 


NUMBER OF STATEVE"ITS: 


COMPLEXITY 


21 
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Pace 19 of 


NTAT ION 


m 
- 
- 


OIRECTEO GRAPH CEPRES 


- 
ro 


6 
PROJECT 
Program oart 


ANNE x 


MEASURES: 


COMPLEXITY 
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ANNEX б Pace 11 of >d 


DIRECTED GRAPH REPRESENTATION 
PROJECT = : 4 


Program part : STORE 


COMPLEXITY MEASURES: 


ШІСЕНБ OF STATEMENTS: 19 
Rees GE NCCES: 


М 
К 
C 


«CC 
f (DD 
Mmm 
m 
E NA 
191» 
т ~ XK 
€C — 
£ Tin 
(DIN 
< 02-1 


-4 771773 


C NUNMECA: (С)= 5 


ЫП СЕС е: O) 


о> > 


T 
т> 
(D 
ha 


>72> e dd А 
OOOONMNdnam 
€1C20C20C)020C 0C) 1» 
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sIn D topo 


J (PF CP GIN a 


سے س چ س چ >« ж «е‏ 
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пт 
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АММЕХ б Раае 12 of 34 


O 


[ ЗЕСТЕВ САЗРН 2REPRLESENTATION 
PROJECT 2-32 4 


Program oart : GET ATTRIRITES AND VALUES 


a) 3 of nodes: 9 © 
БЕ: агсз : 1l 
C) 3 of statements: 20 © 
gy of sats: * 


e) Reachanilitv: + 


еа е ааа ооа 
« Nurcer nf oətns 
ang reachanılıry 


are very Jarce, 
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ANNEX 


PROJECT = 


Е 


2 4 


Program part : 


а) + 
Б) 4 
с) = 
a) 3 


о} 
of 
of 


о” 


nodes: 


arcs . 


BIRELTED 
GET VALUE 
E 

25 


statements: 37 


catns; 


№ 


ә) reacracility: * 


t) Cyvyclomatic 


mymoer: à 


* Numoer of oaths 


апа тәастарт теу 


are уегу 


larse, 


Расе 14 о” 34 


GRAPH REPRESENTATION 
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ANNEX G Face 15 gf $a 


DIRECTED GRAPH ЗЕРНЕЗЕМТАТ [ОМ 
PROJECT = : 4 


Program oart : FIND ATTRIBUTE 


COMPLExITY MEASURES: 
NUMBER OF STATEMENTS: 13 
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COMPLEXITY M 


NUMBER OF ST 
NUNBER 
NUN 
NUM 
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ANNEX G Paqe 


DIRECTED LRAPH REPRESENTATION 
PROJECT * : d 

Раат oat : SKIP, FIXO COMMAND, GET CONDITIONS, 

TESTS SLU 

E ASUIRE S: 

АЕ ЛЕТ 525 = 12 @ 

GES: 4 

(577: 4 

TRS? 2 

ШУЕЕЯ v(c)= 2 


С 


г 
n 


2222009 
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COMPLEXITY 


NUMBER OF 


NUMBER CF 
NUMBER CF 
Ў ЕЕ 
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SLM: 
REACHAEILI 
Cr DIRECTE 


ANNEX G 


PROJECT s 


Program Dart 


Е: 
Sha TEME MT 


5: 
NEG ESE 13 
ARCS : 17 
ATES: l6 
М,МВЕЕ; 
n 
TY Cr > 
: i 
4 1 
: 1 
° 1 
: 1 
2 1 
: 1 
: 1 
2 1 
: 1 
2 1 
: ] 
: 1 
: 1 
: 1 
: 1 
; 1 
l£.. cocoa 
ТУ INDEX 
С СКАРЕ: 


DIRECTED 


[\ТЕЗРЗЕТ 


GRAPH PEPRZSENTATION 
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ANNEX G 


DIRECTED GRAPH DEPRESENTATION 
PROJECTES: 4 


Program oarr SHIFT 


BEMPEEXITY MEASURES: 


NIJMBER OF STATEMENTS: 21 
NUMBER CF ACCESS 1 
NUNBER CF ARCS 3 I3 
NUMBER CF PATES: Я 
CYCLCMATIC NuM8BER: V(C)= 4 
ESDCEABILITY CF NCUES: 
МЕСЕ 1 2 1 
ІШСЕ 2 : 1 
NEES 3 : 1 
NOCE 4 2 1 
NE CS 5 2 4 
NL € ё : 2 
NCCE 7 : 4 
NOCE š : € 
ND D = S 2 4 
NORE LE : £ 
меге I : в 
SUM: 222822000 
REACRABILITY INCEX . 
m -EDIRECIEC CRAPF HH EIS] 





Sa. 


Расе 
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ANHEX G 


PROJECT = 


Program oart 


COMPLEXITY MEASURES: 


DIRECTED 


CTS TOONASE 


NUMBER OF STATEMENTS: 11 
NUMBER СЕ ACCES: 5 
BEMBER CF ARCS : т 
NUMBER CF РАТЫ: - 
BYXCECMATIC NUMSER: У(Сіз 5 
ШСІСКАЕГГІТҮ СҒ NCCES 
BRUCE 1 : l 
NOCE 2 1 
ШЕГЕ 5 x 4 
МЕСЕ в 2 
МЕГЕ а - 
NCCE 6 : 4 
SUM: ЕЗ ОВЕС 
BESCEABILITY INLEX 
СЕ ОІКЕСТЕС СЧАРР 2.686666 


= 296 


БРАРН РЕРВЕЗЕМТАТЕОМ 
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ANNEX С 


PROJECT 2 + 


Program part 


COMPLEXITY MEASURES: 
OBER OF STATEMENTS: 13 


4 


DIRECTED G9APM PEPPESENTATION 


T ST SIR 


NUNBER CF NCLES: 3 
ІШІНЕН СЕ АЯСЫ: 8 
NUMBER CF FATFS: 3 
БОС СУАТ С NUMBER V(G)= 2 
ШЕНСГРАВІСІТУ СР МССЕЗ5: 
КЕШСЕ 15972 1 
ЫСГЕ 272 1 
NEES = WS 1 
КЕСЕ 4 3 1 
КОСЕ 5 ¢: 1 
Merc é : l 
МЕСЕ LS 1 
NCCE 8 3 2 
SUM: 9.C00GG0 
q O О INCSX 
meee lRECTEC GRAPES 2225006 


РАЙ 


Pace 2N ot 
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ANNEX G Pace 21 cf 3% 


DIRECTED GRAPH REPRESENTATION 
PROJECT 2 78 
Program озго 2 7FTNDTMEMBER, FINDATTRTBUTE, АкТІТЕ RESULTS 


BESELEXITT “MEASURES: 
BUMEER Or STATEYVENTS: 13 > lo 


NUMBER CF ACCES: 7 
NUNBER CF ARCS : © 
NUNDER CF FATES: 1 
CYCLCMATIC NUMBER: V(G)= E 2 a 
> Y 1^ 
E É ый Results") 
RE2CFABILITY CF MCDES:: 
NOGICE І : 1 
ШЕГЕ 29 7 
NGO CE 2 : а 
МЕСЕ 4 3 š 
KEES 3 £ é 
NES E 6 7 
NO CE Іі - 1 
SUN: 34.CCCCO 
HESCEARILIIY. INDEX 
СЕ CISECTEC GRAPE: 4.257142 
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АММЕХ С Pace ¿2 af 34 


DIRFCTED GRAPH FEPPESENTATIGN 
PROTECT => 4 
Peooram cart : LISIATFRISUTE 


а) 2 of nenes: 16 

© feof eares. = 2] 

CJ 5S 5f Statements: 53 
а а с Бага t 

е) De3cnabiliry: ж 


t 


f) Cyclomatic nynner?! 7 


, 
* Numcer of oatns © 
апа reacranility 
e = 
| 12 


аге very larae. 
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ANNEX G Pace 23 of 33 


. DIRECTED GRAPH НЕРЗЕЗЕМТАТТОМ 
PROTECT e: 4 


Program oarct : LIST™ 


COMPLEXITY MEASURES: 
NUMBER OF STATEMENTS: 24 © 
NEMS ER CF AGCEES: 12 
NUMBER CF AGES : 15 
NUNBER CF ESIFS: | La 
CYCLCMATIC NUMBER: V(G)= 5 
RE£CFABILITY CF NUBES: 
NCCe 1 1 
МЕГЕ 2 : 1 
NET < 2 2 2 
КЕШЕ 4 : 2 
NE E E : 2 
МЕСЕ é : 2 
КЕГЕ 2 2 2 
rece Е : 4 
ELE 50: 8 
NCCE IE 3 4 
КЕШЕ LI ° £ 
КОЕ 12 : 8 
К с pe 2 16 

БСМ АСС (G (e @ @ [9 
БЕАСРАВИГТТУ INCEX 





= SO = 





5ч 
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GRAPH REPRESENTATION 
RANGE 


DIRECTED 
COMPARE 


» 
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АНМЕХ G 
PROJECT 
Program oart 


8 
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ANNEX G Page 25 of 34 


DIRECTED GREP PEPRESENTATION 
PROJECT 2 : u 
Program part : ATIR, УАТСН[МС, CHANGE “EY 


COMPLEXITY MEASURES: 


NUMBER ОҒ STATEMENTS: 10 - 17 
NUMBER CF NCCES: 6 
NUMBER CF ARCS : | & 

2 

V 


ү 


NUMBER CF PATFS: . 
ЕНОГЕМАТІС NUMBER: (с) = 2 O © 
QEACFABILITY CF ACCES: 
NCCE T : 1 
ACCE 2° E 1 
NCCE 2 1 
Mure 4 1 
NG C 5 2 
NG CE é ¢ 2 
SUM: BC) 
REACFAEILITY INCEX с 
CF DIRECTED GRAFF luem ce 
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ANNEX G 


CIRECTED GRAPH REPRESENTATION 


PROJECT z : 4 


Firogram Dart 2 PA 


COMPLEXITY MEASURES: 
NUMBER OF STATEMENTS: 19 


NUMBER CF NCCES: 19 
NUMBER CF ARCS : ІСІ 
NUMBER CF PATES: a 
CYCUCMATIC NCENBER:;: V(C)= 3 
ШЕЙЕРАВТІГІТҮ Сғ NCCES: 
NC CE [ ; 1 
МЕРЕ 2 : 1 
NOIRE © : 1 
МОЕ 4 2 1 
NGRE SE: 1 
NCLE е 3 1 
NCCE 1: 1 
NG CE ë : 2 
NCCE S : 2 
NE GS I3 2 E 
SUM: т. 1000 
=SACFARAILITY INCEX 
БЕРШІПЕСТЕС СлАавр: SS COCO 


SOS 
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Page 


REPRFSENTATIO. 


RAPE 
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DIRECTED | 
: 4 
FIND 


Program Sart 


АМНЕХ С 
PROJECT = 
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PA wry 
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ru 
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ANNEX G Face 28 of 34 


MERECES Grice Frere Serial ІІ 
PROJECT z: 4 
Program part : GET -"EGUEST 


a) = of nodes: 12 
5) 224! arcs t 15 
СШ 352” Statements: :5 
d) sf sarns. ^ 
e) Reachanility: + 
f) Cyclomatic nu-cbDer: 
я Mumober sor озса 
and rescnapilitv 


are very larae., 
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ANNEX б 


GRAPH BEPRESENTATION 


DIRECTED 


3 


PROJECT = 


Program oart 


MEASURES: 


COMPLEXITY 


59 


e Errar 


49 
с 


ША ШЕ ЕМ: 
Е 


2 


ur 


59 


Error 


+ 


A, 


22 


DES 


TES Ilir CF NC 


22 
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ANNEX G Page 30 of 54 


DIRECTED GRAPH SEORESENTATION 
PROJECI 2 g a 
Program oart : TEST COHDITIONS 


ВБ РЕЕХ ГГТУ УЕЗЗЬНЕЗ: 
BUMRERCGOESSTATEMESTS: 19 





NUNBER CF NCCES: 19 
NUMBER CF ARCS : 12 © Ereor ses 
NUMBER CF PATHS: Š 
ЕШСЕСМАТІС КИМ8ЕМ: V(G)s 5 
OS CFASILITY CF NCCES 
МСС 1 : 1 
пес 2 : 2 
ВЕСЕ d T 
КИЕ = 4 : 2 
NEES 2 1 2 
МЕСЕ € : 2 
КЕГЕ 7 : 2 
ШЕГЕ Ва: 2 
NCCE с: 4 
КЕСЕ ECC: € 
ED Uv 24. C20000 
ШЕССБАВТІСІІҮ IMC<X 
CP DIRECTIE CRABE 2.4СС0С92 
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ANNEX С Page 31 of 34 


DIRECTED GRAPH REPRESENTATION 
PROJECT * : 4 
Program part : COMPARE MANY 


a) £ of nodes: 12 

b) #2 of arcs : 14 

с) 2 of statements: 27 
d) 3 of paths: * 

e) Reachability: * 

f) Cyclomatic number: 4 


* Number of oaths 


and reachability 
e Error 2146 
are very larae. 


кто се Шы 





АММЕк 0 


DIRECTED GRAPH SFPRESERSTATION 
PROJECT s : ü 


Program oart 3: LLI“IT 


БИМВГЕХТТҮ MEASURES: 


BUUBERCOF STATEMENTS: 15 
NUMBER CF NCCES: 7 

NUMBER CF ARCS : d 

NUMBER CF FATES: 7 
CYCLCMATIC NUMBER: V(<)= 3 
REACH ZEICITY CF NCDES 

NOCE 1 : n 

МЕСЕ 2 : 7 

NOCE 3 : Е 

NEL E 4 : Е 

Bel eS S 

NC LE € : 7 
Bars 4 1: 1 

SUM: 26.469000 

EESCrAaBILITY INCEX P 

СР DIKECTSC GK&AFF 52142427 
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ANNEX G Paoe 33 of د3‎ 


DIRECTED GPAPH AEFRESENTATICN 
PRONE CET: 4 


Бесабпат Sart * УТ 


EDMELEXITY MEASURES: 





NUMBER OF STATEMENTS: 17 
NUMBER CF ACCES: 1С ques 
NUMBER CF ARCS : |2 + Error = 33 
NUMBER CF PATES: 14 Eno 45 
EICLEMATIC NUMBER: МС) = 2 
САСБАРІПГТТҮ СГ МЕСЕ 3: 
паб = 1 2 E 
ЕВЕ 2 2 
NCCE a: 1 
МЕГЕ > : Z 
NCCE в: 14 
NULL E € 2 ГС 
AcCé 7 : € 
NEBE 8 : 12 
NERS S : 14 
NGCE ГЕ : 14 
SUM: ЧЕ. 66060 
REACPABILITY INEEX . 
СЕ ПІКЕСТЕГ GRAPE: - 7.259995 


So EO >= 





ANNEX G 
PROJECT = 
Program oart 
COMPLEXITY MEASURES: 
NUMBEP OF STATEMENTS: 15 
NUMBER CF ACCES: 4 
NUMBER CF ARCS : 4 
NU*BER CF FATES 2 
ШЕГСМАТІС NUMBER : МС) = 
QREACRACILITY CF ACOES: 
КОСЕ E 1 
NC CE 2 | 
Bele 3 : 1 
NELE په‎ 4 2 
SUM: 5.060900 
MATT INCEX 
CF CIRECTSC GRAPF: 1 


ОТРЕСТЕО GRAPH SEPRESENTATION 


SALICH 


=> = 
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АММЕХ Н Page 1 of 3 


TEST PHASE DESCRIPTION 
Project 98 : 4 


Test run 8 : 1 Including 5 Test Steps 


Begin of Test (day/time) : 04/29/1330 End of Test (aay/time) : 04/29/1530 


CPU time for necessary compiles (in sec.): 9.09 
а) 9,09 6) c) d) e) f) g) 


CPU time for TEST run (sec) : 12.8 


Man Hours for this Test run : 2.0 (including preoaration of 
tests) 


12) 
EXPECTED (i ACTUAL 4 ERROR DAY 
RESULT ¡RESULTS $9. (TIME 


TEST, OBJECTIVE н 
' 
; (TOLERANCE) 


wo = еә 
= oa 


Test of I/O func- {1/0 сап be direc- 

ions under CP/CMS ted as designed: 

¡"Data base infor- 

{nation is read 

{fron file labeled 

("DBASE INPUT" 

-Commanas are 

¡input via termi- 

‘nal only 

-Qutput can be 

¡directed oy user 

‘to terminal or 

‘file 

2 ¡Check boundary ¡Program neglects 
(Conditions under ¡input or provides 
!СР/СМ5 appropriate error 
' Imessaqes 

3 (Test SU functions ia)Members can oe 

t! under CP/CMS (added to the data 

i | базе 

' ıD)Data base in- 

‘ (formation can be 

' tcan be written on 

i ‘outout file such 

' ‘that this file 

i 

' 

4 

' 

' 

6 

0 

| 

| 

' 


ee mn ma mn za zu mea р mn nm Da pa ma sn mn m op mn ae ha ma zn mm me mn dm 


¡could be used as 
¡input file for 
¡subsequent runs 
ıc)Items of М2 сап 
¡be examined 
Check Diagnostics 
S {Test Termination 
¡of program 


=e ee al ma aa aa ma pa zn nn an Tr nn mn a um ҹә wee am 2. 2. 2 2... 2. 2. ==» eww e mo e uo u en 0 == -— 
a ea e 2. e o. za Sa oa np za mo za me pa Du ze 20 2% 2. 20 2% a a». 8 -. 2. 2% +» =4* @e «ә = 


-- = 
Do 


Un n3 
co 


e" -= 


COMMENTS 
ANO 

CODED ERROR 
TPES 


1) Record when 
error occurs 





ANNEX H Page 2 of 3 


TEST PHASE OESCRIPTION 
Project # 3 4 
Test run # : 2 Including 2 Test Steps 
Begin of Test (day/time) : 05/01/1200 End of Test (day/time) : 05/02/2200 


CPU time for necessary compiles (in sec.): duy 
ӘН 98:75 b) Е) а) е) f) g) 


CPU time for TEST run (sec) : 12.40 


Man Hours for this Test run : 4.0 (including creparation of 


tests) 
1) 
EST; ШӘШТЕСТУЕ ! EXPECTED ! ACTUAL! ERROR!O0OAY | COMMENTS 
STEP, ' RESULT RESULT: 4 ЕПІУЕ; AND 
' ¦ (TOLERANCE) ' ' ı CODED ERROR 
' j ' ' ' ' ТУРЕЗ 
| ¡Test comparison ıComoarison must ¡Does i| ¡5/01; 1) Record when 
¡Of ramge values ¡always be correctimot ' ‚1200: error occurs 
' ' ‘work | "1700105 
' ı for н ' Implementation 
' ¡nega” i ' |. of mew code 
' | tiva | ! ¦ necessary to 
! I Inum= 4 ' handle all! 
' і ¡bers |! 15/01! cases E 
' í і 11730; 
' ; i ' ' 
2 ¡Receat step 1 - Е "S702! 
fusing corrected ' ' 11600! 
version of program: і ' 5702, 
' ' ' 12200! 
' ' ! ' 


1 





АММЕХ Н Page 3 of 3 


TEST PHASE DESCRIPTION 
Project 3 : 4 
Test run 3 : 3 Including 1 Test Steos 
Begin of Test (day/time) : 05/03/0900 End of Test (day/time) : 05/03/1800 


CPU time for necessary compiles Cin sec.): 9.68 
a) 9.58 6) С) а) е) f) g) 


CPU time for TEST run (sec) : 12.84 


Man Hours for this Test rum : 5.0 (including preparation of 
tests) 


1) 


BEST! OBJECTVE ¦ EXPECTED IACTUALIERRORIDAY ; COMMENTS 

STEP! ¡ PESULT ¡RESULT! 3 ME АМО 
i ¦ (TOLERANCE) i i ' ı CODED ERROR 
' ' ' ' ' I TYPES 

| !Test proaram ungeriA!! functicns ' ' 15/031 1) Record when 

ICP/CMS using ‘should work the | ' ' 0900; error occurs 
‘radars as data ¡Same way as for | 0.%., | ' ' 
ımembers ımembers used in | : : ! 
iDrevious test andi ' ' ' 
| ¡debug runs ' i ' ' 
i ¡(provided that ' ' ' ' 
f ial! attribute ' ' ' ' 
' ıvalue pairs are | ' ' 
' ¡within designed  ¡ ' 15/03; 
' limits) i ' (1800; 
' t ! t 
' t ' ' 
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